Command line
python /home/saxelrod/Repo/projects/chemprop/chemprop/train.py --config_path /home/saxelrod/chemprop_cov_2_gen/models/from_whim_crest_weights_auc/config.json --data_path /home/saxelrod/rgb_nfs/dsets/cov_2_gen/train_full.csv --dataset_type classification
Args
{'activation': 'ReLU',
 'aggregation': 'mean',
 'aggregation_norm': 100,
 'atom_descriptors': None,
 'atom_descriptors_path': None,
 'atom_descriptors_size': 0,
 'atom_features_size': 0,
 'atom_messages': False,
 'batch_size': 50,
 'bias': False,
 'cache_cutoff': 10000,
 'checkpoint_dir': None,
 'checkpoint_path': None,
 'checkpoint_paths': None,
 'class_balance': True,
 'config_path': '/home/saxelrod/chemprop_cov_2_gen/models/from_whim_crest_weights_auc/config.json',
 'crossval_index_dir': None,
 'crossval_index_file': None,
 'crossval_index_sets': None,
 'cuda': True,
 'data_path': '/home/saxelrod/rgb_nfs/dsets/cov_2_gen/train_full.csv',
 'dataset_type': 'classification',
 'depth': 6,
 'device': device(type='cuda', index=3),
 'dropout': 0.05,
 'ensemble_size': 1,
 'epochs': 2000,
 'extra_metrics': [],
 'features_generator': None,
 'features_only': False,
 'features_path': ['/home/saxelrod/chemprop_cov_2_gen/features/whim/train_whim_mean_crest_weights.npz',
                   '/home/saxelrod/chemprop_cov_2_gen/features/whim/train_whim_std_crest_weights.npz'],
 'features_scaling': True,
 'features_size': None,
 'ffn_hidden_size': 2100,
 'ffn_num_layers': 1,
 'final_lr': 0.0001,
 'folds_file': None,
 'gpu': 3,
 'grad_clip': None,
 'hidden_size': 2100,
 'ignore_columns': None,
 'init_lr': 0.0001,
 'log_frequency': 10,
 'max_data_size': None,
 'max_lr': 0.001,
 'metric': 'auc',
 'metrics': ['auc'],
 'minimize_score': False,
 'mpn_shared': False,
 'multiclass_num_classes': 3,
 'no_cache_mol': False,
 'no_cuda': False,
 'no_features_scaling': False,
 'num_folds': 10,
 'num_lrs': 1,
 'num_tasks': 1,
 'num_workers': 8,
 'number_of_molecules': 1,
 'pytorch_seed': 0,
 'quiet': True,
 'save_dir': '/home/saxelrod/chemprop_cov_2_gen/models/from_whim_crest_weights_auc',
 'save_preds': False,
 'save_smiles_splits': False,
 'seed': 0,
 'separate_test_features_path': ['/home/saxelrod/chemprop_cov_2_gen/features/whim/test_whim_mean_crest_weights.npz',
                                 '/home/saxelrod/chemprop_cov_2_gen/features/whim/test_whim_std_crest_weights.npz'],
 'separate_test_path': '/home/saxelrod/rgb_nfs/dsets/cov_2_gen/test_full.csv',
 'separate_val_features_path': ['/home/saxelrod/chemprop_cov_2_gen/features/whim/val_whim_mean_crest_weights.npz',
                                '/home/saxelrod/chemprop_cov_2_gen/features/whim/val_whim_std_crest_weights.npz'],
 'separate_val_path': '/home/saxelrod/rgb_nfs/dsets/cov_2_gen/val_full.csv',
 'show_individual_scores': False,
 'smiles_columns': [None],
 'split_sizes': (0.8, 0.1, 0.1),
 'split_type': 'random',
 'target_columns': None,
 'task_names': ['sars_cov_two_active'],
 'test': False,
 'test_fold_index': None,
 'train_data_size': None,
 'undirected': False,
 'use_input_features': True,
 'val_fold_index': None,
 'warmup_epochs': 2.0}
Loading data
Number of tasks = 1
Fold 0
Splitting data with seed 0
Class sizes
sars_cov_two_active 0: 98.39%, 1: 1.61%
Total size = 3,294 | train size = 3,294 | val size = 1,096 | test size = 1,086
With class_balance, effective train size = 106
Building model 0
MoleculeModel(
  (sigmoid): Sigmoid()
  (encoder): MPN(
    (encoder): ModuleList(
      (0): MPNEncoder(
        (dropout_layer): Dropout(p=0.05, inplace=False)
        (act_func): ReLU()
        (W_i): Linear(in_features=147, out_features=2100, bias=False)
        (W_h): Linear(in_features=2100, out_features=2100, bias=False)
        (W_o): Linear(in_features=2233, out_features=2100, bias=True)
      )
    )
  )
  (ffn): Sequential(
    (0): Dropout(p=0.05, inplace=False)
    (1): Linear(in_features=2328, out_features=1, bias=True)
  )
)
Number of parameters = 9,412,429
Moving model to cuda
Epoch 0
Validation auc = 0.566374
Epoch 1
Validation auc = 0.576732
Epoch 2
Validation auc = 0.612604
Epoch 3
Validation auc = 0.577277
Epoch 4
Loss = 7.2265e-01, PNorm = 67.4103, GNorm = 1.2696, lr_0 = 2.0385e-04
Loss = 6.7344e-01, PNorm = 67.4123, GNorm = 3.6127, lr_0 = 2.1077e-04
Validation auc = 0.598430
Epoch 5
Validation auc = 0.617838
Epoch 6
Validation auc = 0.663795
Epoch 7
Validation auc = 0.630704
Epoch 8
Validation auc = 0.518399
Epoch 9
Loss = 6.5808e-01, PNorm = 67.4511, GNorm = 2.7178, lr_0 = 3.0077e-04
Validation auc = 0.659434
Epoch 10
Validation auc = 0.582784
Epoch 11
Validation auc = 0.648313
Epoch 12
Validation auc = 0.643788
Epoch 13
Validation auc = 0.641716
Epoch 14
Loss = 7.0582e-01, PNorm = 67.5271, GNorm = 1.1390, lr_0 = 4.0462e-04
Validation auc = 0.656654
Epoch 15
Validation auc = 0.635556
Epoch 16
Validation auc = 0.646677
Epoch 17
Validation auc = 0.643733
Epoch 18
Loss = 6.0340e-01, PNorm = 67.6235, GNorm = 1.0349, lr_0 = 4.9462e-04
Loss = 6.0454e-01, PNorm = 67.6349, GNorm = 3.4085, lr_0 = 5.0154e-04
Validation auc = 0.654637
Epoch 19
Validation auc = 0.657035
Epoch 20
Validation auc = 0.667121
Epoch 21
Validation auc = 0.663141
Epoch 22
Validation auc = 0.653928
Epoch 23
Loss = 6.5418e-01, PNorm = 67.7815, GNorm = 1.1727, lr_0 = 5.9846e-04
Loss = 5.5956e-01, PNorm = 67.7924, GNorm = 2.7984, lr_0 = 6.0538e-04
Validation auc = 0.662433
Epoch 24
Validation auc = 0.642643
Epoch 25
Validation auc = 0.637955
Epoch 26
Validation auc = 0.593414
Epoch 27
Validation auc = 0.599193
Epoch 28
Loss = 6.2371e-01, PNorm = 67.9796, GNorm = 1.2558, lr_0 = 6.9538e-04
Validation auc = 0.608461
Epoch 29
Validation auc = 0.616257
Epoch 30
Validation auc = 0.633157
Epoch 31
Validation auc = 0.625143
Epoch 32
Validation auc = 0.618165
Epoch 33
Loss = 5.4554e-01, PNorm = 68.2299, GNorm = 0.7133, lr_0 = 7.9923e-04
Validation auc = 0.593851
Epoch 34
Validation auc = 0.621709
Epoch 35
Validation auc = 0.627814
Epoch 36
Validation auc = 0.620182
Epoch 37
Loss = 5.7447e-01, PNorm = 68.5358, GNorm = 0.9687, lr_0 = 8.8923e-04
Loss = 5.2113e-01, PNorm = 68.5612, GNorm = 3.4313, lr_0 = 8.9615e-04
Validation auc = 0.609497
Epoch 38
Validation auc = 0.616420
Epoch 39
Validation auc = 0.595541
Epoch 40
Validation auc = 0.586055
Epoch 41
Validation auc = 0.566756
Epoch 42
Loss = 4.8908e-01, PNorm = 68.9743, GNorm = 1.6710, lr_0 = 9.8615e-04
Validation auc = 0.569863
Epoch 43
Validation auc = 0.574933
Epoch 44
Validation auc = 0.589271
Epoch 45
Validation auc = 0.641007
Epoch 46
Validation auc = 0.617075
Epoch 47
Loss = 5.5962e-01, PNorm = 69.5550, GNorm = 0.9458, lr_0 = 9.9977e-04
Validation auc = 0.616420
Epoch 48
Validation auc = 0.620182
Epoch 49
Validation auc = 0.633266
Epoch 50
Validation auc = 0.644060
Epoch 51
Loss = 3.9664e-01, PNorm = 70.0869, GNorm = 1.0353, lr_0 = 9.9954e-04
Loss = 6.6071e-01, PNorm = 70.1237, GNorm = 4.2803, lr_0 = 9.9952e-04
Validation auc = 0.645369
Epoch 52
Validation auc = 0.639372
Epoch 53
Validation auc = 0.619419
Epoch 54
Validation auc = 0.631303
Epoch 55
Validation auc = 0.627869
Epoch 56
Loss = 5.4281e-01, PNorm = 70.7268, GNorm = 0.9707, lr_0 = 9.9927e-04
Loss = 5.2460e-01, PNorm = 70.7714, GNorm = 2.5684, lr_0 = 9.9926e-04
Validation auc = 0.611459
Epoch 57
Validation auc = 0.597067
Epoch 58
Validation auc = 0.587799
Epoch 59
Validation auc = 0.587908
Epoch 60
Validation auc = 0.631413
Epoch 61
Loss = 5.6595e-01, PNorm = 71.3666, GNorm = 2.4522, lr_0 = 9.9903e-04
Validation auc = 0.644388
Epoch 62
Validation auc = 0.643188
Epoch 63
Validation auc = 0.656218
Epoch 64
Validation auc = 0.637082
Epoch 65
Validation auc = 0.644224
Epoch 66
Loss = 4.8618e-01, PNorm = 72.1922, GNorm = 0.7559, lr_0 = 9.9876e-04
Validation auc = 0.653383
Epoch 67
Validation auc = 0.645314
Epoch 68
Validation auc = 0.646895
Epoch 69
Validation auc = 0.649785
Epoch 70
Loss = 3.9102e-01, PNorm = 72.8276, GNorm = 1.5539, lr_0 = 9.9853e-04
Loss = 4.1282e-01, PNorm = 72.8740, GNorm = 1.7728, lr_0 = 9.9851e-04
Validation auc = 0.646514
Epoch 71
Validation auc = 0.656436
Epoch 72
Validation auc = 0.665595
Epoch 73
Validation auc = 0.670174
Epoch 74
Validation auc = 0.672954
Epoch 75
Loss = 3.7581e-01, PNorm = 73.4957, GNorm = 2.1174, lr_0 = 9.9828e-04
Validation auc = 0.651747
Epoch 76
Validation auc = 0.633048
Epoch 77
Validation auc = 0.629886
Epoch 78
Validation auc = 0.609388
Epoch 79
Validation auc = 0.564630
Epoch 80
Loss = 3.0032e-01, PNorm = 74.1961, GNorm = 1.2644, lr_0 = 9.9802e-04
Validation auc = 0.564793
Epoch 81
Validation auc = 0.637191
Epoch 82
Validation auc = 0.665649
Epoch 83
Validation auc = 0.670501
Epoch 84
Loss = 1.9678e-01, PNorm = 74.8931, GNorm = 1.6850, lr_0 = 9.9779e-04
Loss = 2.7106e-02, PNorm = 74.9476, GNorm = 0.4198, lr_0 = 9.9777e-04
Validation auc = 0.624162
Epoch 85
Validation auc = 0.633212
Epoch 86
Validation auc = 0.641444
Epoch 87
Validation auc = 0.680041
Epoch 88
Validation auc = 0.691926
Epoch 89
Loss = 3.0013e-01, PNorm = 75.7430, GNorm = 2.0644, lr_0 = 9.9752e-04
Loss = 4.3533e-01, PNorm = 75.7908, GNorm = 7.3586, lr_0 = 9.9750e-04
Validation auc = 0.695415
Epoch 90
Validation auc = 0.640517
Epoch 91
Validation auc = 0.621381
Epoch 92
Validation auc = 0.606662
Epoch 93
Validation auc = 0.615875
Epoch 94
Loss = 4.3641e-01, PNorm = 76.5640, GNorm = 1.8703, lr_0 = 9.9727e-04
Validation auc = 0.624325
Epoch 95
Validation auc = 0.620836
Epoch 96
Validation auc = 0.619419
Epoch 97
Validation auc = 0.591997
Epoch 98
Validation auc = 0.604536
Epoch 99
Loss = 1.4592e-01, PNorm = 77.3622, GNorm = 1.5766, lr_0 = 9.9701e-04
Validation auc = 0.601428
Epoch 100
Validation auc = 0.611896
Epoch 101
Validation auc = 0.600338
Epoch 102
Validation auc = 0.639208
Epoch 103
Loss = 2.1697e-01, PNorm = 77.9617, GNorm = 1.3586, lr_0 = 9.9678e-04
Loss = 1.8297e-01, PNorm = 78.0003, GNorm = 3.5277, lr_0 = 9.9676e-04
Validation auc = 0.654419
Epoch 104
Validation auc = 0.625252
Epoch 105
Validation auc = 0.621927
Epoch 106
Validation auc = 0.624652
Epoch 107
Validation auc = 0.635992
Epoch 108
Loss = 1.4798e-01, PNorm = 78.6063, GNorm = 1.2101, lr_0 = 9.9651e-04
Validation auc = 0.644497
Epoch 109
Validation auc = 0.616802
Epoch 110
Validation auc = 0.615766
Epoch 111
Validation auc = 0.634411
Epoch 112
Validation auc = 0.628578
Epoch 113
Loss = 1.1699e-01, PNorm = 79.2367, GNorm = 1.2717, lr_0 = 9.9627e-04
Validation auc = 0.624434
Epoch 114
Validation auc = 0.625961
Epoch 115
Validation auc = 0.627542
Epoch 116
Validation auc = 0.616911
Epoch 117
Loss = 9.7888e-02, PNorm = 79.7364, GNorm = 0.7811, lr_0 = 9.9604e-04
Loss = 3.5359e-01, PNorm = 79.7673, GNorm = 7.3702, lr_0 = 9.9602e-04
Validation auc = 0.618928
Epoch 118
Validation auc = 0.625525
Epoch 119
Validation auc = 0.612822
Epoch 120
Validation auc = 0.622581
Epoch 121
Validation auc = 0.618983
Epoch 122
Loss = 1.4467e-01, PNorm = 80.3641, GNorm = 1.2819, lr_0 = 9.9577e-04
Loss = 5.5409e-02, PNorm = 80.4014, GNorm = 1.1662, lr_0 = 9.9575e-04
Validation auc = 0.639154
Epoch 123
Validation auc = 0.638336
Epoch 124
Validation auc = 0.629559
Epoch 125
Validation auc = 0.611132
Epoch 126
Validation auc = 0.598921
Epoch 127
Loss = 8.8296e-02, PNorm = 80.8478, GNorm = 2.0677, lr_0 = 9.9552e-04
Validation auc = 0.607371
Epoch 128
Validation auc = 0.615548
Epoch 129
Validation auc = 0.628959
Epoch 130
Validation auc = 0.638009
Epoch 131
Validation auc = 0.636155
Epoch 132
Loss = 2.0867e-02, PNorm = 81.3524, GNorm = 0.2034, lr_0 = 9.9526e-04
Validation auc = 0.630704
Epoch 133
Validation auc = 0.620019
Epoch 134
Validation auc = 0.608406
Epoch 135
Validation auc = 0.629613
Epoch 136
Loss = 1.9979e-01, PNorm = 81.7099, GNorm = 0.7262, lr_0 = 9.9503e-04
Loss = 3.2438e-01, PNorm = 81.7521, GNorm = 6.0145, lr_0 = 9.9501e-04
Validation auc = 0.644169
Epoch 137
Validation auc = 0.676988
Epoch 138
Validation auc = 0.682331
Epoch 139
Validation auc = 0.684457
Epoch 140
Validation auc = 0.662978
Epoch 141
Loss = 1.5869e-01, PNorm = 82.5336, GNorm = 1.3149, lr_0 = 9.9477e-04
Validation auc = 0.632612
Epoch 142
Validation auc = 0.613531
Epoch 143
Validation auc = 0.597231
Epoch 144
Validation auc = 0.609279
Epoch 145
Validation auc = 0.636919
Epoch 146
Loss = 1.3852e-01, PNorm = 83.2638, GNorm = 0.7491, lr_0 = 9.9452e-04
Validation auc = 0.647222
Epoch 147
Validation auc = 0.632067
Epoch 148
Validation auc = 0.620073
Epoch 149
Validation auc = 0.606444
Epoch 150
Loss = 1.2855e-01, PNorm = 83.8280, GNorm = 1.0915, lr_0 = 9.9429e-04
Loss = 7.6521e-02, PNorm = 83.8645, GNorm = 1.6991, lr_0 = 9.9427e-04
Validation auc = 0.572098
Epoch 151
Validation auc = 0.589271
Epoch 152
Validation auc = 0.623508
Epoch 153
Validation auc = 0.638609
Epoch 154
Validation auc = 0.643788
Epoch 155
Loss = 3.6289e-02, PNorm = 84.3235, GNorm = 0.3561, lr_0 = 9.9403e-04
Loss = 4.8009e-02, PNorm = 84.3499, GNorm = 0.9383, lr_0 = 9.9401e-04
Validation auc = 0.642316
Epoch 156
Validation auc = 0.636428
Epoch 157
Validation auc = 0.597721
Epoch 158
Validation auc = 0.647877
Epoch 159
Validation auc = 0.665867
Epoch 160
Loss = 1.6695e-01, PNorm = 84.6660, GNorm = 1.0929, lr_0 = 9.9378e-04
Validation auc = 0.662378
Epoch 161
Validation auc = 0.644715
Epoch 162
Validation auc = 0.643570
Epoch 163
Validation auc = 0.646132
Epoch 164
Validation auc = 0.645042
Epoch 165
Loss = 8.3968e-02, PNorm = 85.1438, GNorm = 0.6026, lr_0 = 9.9351e-04
Validation auc = 0.633757
Epoch 166
Validation auc = 0.636210
Epoch 167
Validation auc = 0.640953
Epoch 168
Validation auc = 0.658943
Epoch 169
Loss = 8.5556e-02, PNorm = 85.5867, GNorm = 0.5056, lr_0 = 9.9329e-04
Loss = 6.1004e-02, PNorm = 85.6131, GNorm = 0.9042, lr_0 = 9.9327e-04
Validation auc = 0.674099
Epoch 170
Validation auc = 0.679660
Epoch 171
Validation auc = 0.671210
Epoch 172
Validation auc = 0.666221
Epoch 173
Validation auc = 0.661451
Epoch 174
Loss = 4.6797e-02, PNorm = 85.9239, GNorm = 1.0229, lr_0 = 9.9302e-04
Validation auc = 0.659271
Epoch 175
Validation auc = 0.625143
Epoch 176
Validation auc = 0.623671
Epoch 177
Validation auc = 0.624380
Epoch 178
Validation auc = 0.616366
Epoch 179
Loss = 4.5681e-02, PNorm = 86.2508, GNorm = 0.4835, lr_0 = 9.9277e-04
Validation auc = 0.614294
Epoch 180
Validation auc = 0.604754
Epoch 181
Validation auc = 0.617838
Epoch 182
Validation auc = 0.627814
Epoch 183
Loss = 9.4461e-02, PNorm = 86.4814, GNorm = 2.0410, lr_0 = 9.9253e-04
Validation auc = 0.649567
Epoch 184
Validation auc = 0.648149
Epoch 185
Validation auc = 0.634247
Epoch 186
Validation auc = 0.624216
Epoch 187
Validation auc = 0.615221
Epoch 188
Loss = 7.3652e-02, PNorm = 86.6915, GNorm = 1.3258, lr_0 = 9.9228e-04
Loss = 1.9016e-02, PNorm = 86.7093, GNorm = 0.7172, lr_0 = 9.9226e-04
Validation auc = 0.617620
Epoch 189
Validation auc = 0.612768
Epoch 190
Validation auc = 0.592651
Epoch 191
Validation auc = 0.579131
Epoch 192
Validation auc = 0.635011
Epoch 193
Loss = 1.0647e-01, PNorm = 86.9548, GNorm = 0.6313, lr_0 = 9.9204e-04
Validation auc = 0.653546
Epoch 194
Validation auc = 0.661560
Epoch 195
Validation auc = 0.656327
Epoch 196
Validation auc = 0.650930
Epoch 197
Validation auc = 0.647495
Epoch 198
Loss = 7.7115e-02, PNorm = 87.1980, GNorm = 0.7302, lr_0 = 9.9177e-04
Validation auc = 0.647604
Epoch 199
Validation auc = 0.645968
Epoch 200
Validation auc = 0.642370
Epoch 201
Validation auc = 0.651257
Epoch 202
Loss = 5.0478e-02, PNorm = 87.4077, GNorm = 0.8075, lr_0 = 9.9154e-04
Loss = 1.1812e-01, PNorm = 87.4270, GNorm = 3.1373, lr_0 = 9.9153e-04
Validation auc = 0.671482
Epoch 203
Validation auc = 0.680750
Epoch 204
Validation auc = 0.703211
Epoch 205
Validation auc = 0.711552
Epoch 206
Validation auc = 0.706864
Epoch 207
Loss = 8.8329e-02, PNorm = 87.7482, GNorm = 2.0341, lr_0 = 9.9128e-04
Loss = 1.8757e-01, PNorm = 87.7751, GNorm = 4.8635, lr_0 = 9.9126e-04
Validation auc = 0.704574
Epoch 208
Validation auc = 0.704192
Epoch 209
Validation auc = 0.694924
Epoch 210
Validation auc = 0.688219
Epoch 211
Validation auc = 0.672900
Epoch 212
Loss = 3.4691e-02, PNorm = 88.1488, GNorm = 0.8286, lr_0 = 9.9103e-04
Validation auc = 0.655618
Epoch 213
Validation auc = 0.665922
Epoch 214
Validation auc = 0.653546
Epoch 215
Validation auc = 0.644388
Epoch 216
Loss = 6.4933e-02, PNorm = 88.4241, GNorm = 0.0318, lr_0 = 9.9079e-04
Validation auc = 0.637409
Epoch 217
Validation auc = 0.641444
Epoch 218
Validation auc = 0.624434
Epoch 219
Validation auc = 0.625089
Epoch 220
Validation auc = 0.642861
Epoch 221
Loss = 1.0676e-01, PNorm = 88.8055, GNorm = 1.3943, lr_0 = 9.9054e-04
Loss = 1.3349e-03, PNorm = 88.8412, GNorm = 0.0627, lr_0 = 9.9052e-04
Validation auc = 0.644388
Epoch 222
Validation auc = 0.654037
Epoch 223
Validation auc = 0.653764
Epoch 224
Validation auc = 0.651856
Epoch 225
Validation auc = 0.660088
Epoch 226
Loss = 4.8076e-02, PNorm = 89.1552, GNorm = 0.6511, lr_0 = 9.9030e-04
Validation auc = 0.664613
Epoch 227
Validation auc = 0.667721
Epoch 228
Validation auc = 0.682549
Epoch 229
Validation auc = 0.692798
Epoch 230
Validation auc = 0.700921
Epoch 231
Loss = 2.4953e-02, PNorm = 89.4997, GNorm = 0.4043, lr_0 = 9.9003e-04
Validation auc = 0.705991
Epoch 232
Validation auc = 0.710407
Epoch 233
Validation auc = 0.710625
Epoch 234
Validation auc = 0.704956
Epoch 235
Loss = 1.0070e-02, PNorm = 89.7521, GNorm = 0.1211, lr_0 = 9.8980e-04
Loss = 2.0139e-02, PNorm = 89.7704, GNorm = 0.6226, lr_0 = 9.8979e-04
Validation auc = 0.681895
Epoch 236
Validation auc = 0.677643
Epoch 237
Validation auc = 0.680696
Epoch 238
Validation auc = 0.681350
Epoch 239
Validation auc = 0.691817
Epoch 240
Loss = 1.8932e-01, PNorm = 90.0371, GNorm = 4.9415, lr_0 = 9.8954e-04
Loss = 2.9786e-01, PNorm = 90.0624, GNorm = 7.6766, lr_0 = 9.8952e-04
Validation auc = 0.691326
Epoch 241
Validation auc = 0.669247
Epoch 242
Validation auc = 0.632721
Epoch 243
Validation auc = 0.591888
Epoch 244
Validation auc = 0.625198
Epoch 245
Loss = 3.2277e-02, PNorm = 90.5851, GNorm = 0.3345, lr_0 = 9.8930e-04
Validation auc = 0.676661
Epoch 246
Validation auc = 0.691817
Epoch 247
Validation auc = 0.672845
Epoch 248
Validation auc = 0.673663
Epoch 249
Loss = 2.6333e-01, PNorm = 91.1186, GNorm = 4.9846, lr_0 = 9.8905e-04
Validation auc = 0.692689
Epoch 250
Validation auc = 0.707736
Epoch 251
Validation auc = 0.713351
Epoch 252
Validation auc = 0.709044
Epoch 253
Validation auc = 0.709644
Epoch 254
Loss = 6.2505e-02, PNorm = 91.4312, GNorm = 1.5665, lr_0 = 9.8880e-04
Loss = 6.8260e-01, PNorm = 91.4425, GNorm = 9.2184, lr_0 = 9.8879e-04
Validation auc = 0.715804
Epoch 255
Validation auc = 0.715259
Epoch 256
Validation auc = 0.705174
Epoch 257
Validation auc = 0.699722
Epoch 258
Validation auc = 0.696015
Epoch 259
Loss = 6.0888e-02, PNorm = 91.7522, GNorm = 0.4975, lr_0 = 9.8856e-04
Validation auc = 0.693943
Epoch 260
Validation auc = 0.689364
Epoch 261
Validation auc = 0.685166
Epoch 262
Validation auc = 0.682386
Epoch 263
Validation auc = 0.681622
Epoch 264
Loss = 2.7411e-02, PNorm = 92.0259, GNorm = 0.4085, lr_0 = 9.8830e-04
Validation auc = 0.676879
Epoch 265
Validation auc = 0.672027
Epoch 266
Validation auc = 0.669029
Epoch 267
Validation auc = 0.668266
Epoch 268
Loss = 5.8628e-02, PNorm = 92.1915, GNorm = 0.5653, lr_0 = 9.8807e-04
Loss = 3.1197e-02, PNorm = 92.2034, GNorm = 0.9367, lr_0 = 9.8805e-04
Validation auc = 0.665540
Epoch 269
Validation auc = 0.646296
Epoch 270
Validation auc = 0.665376
Epoch 271
Validation auc = 0.697378
Epoch 272
Validation auc = 0.717494
Epoch 273
Loss = 1.5201e-01, PNorm = 92.5038, GNorm = 1.1673, lr_0 = 9.8781e-04
Loss = 1.1077e-01, PNorm = 92.5415, GNorm = 1.7220, lr_0 = 9.8779e-04
Validation auc = 0.721529
Epoch 274
Validation auc = 0.718748
Epoch 275
Validation auc = 0.712206
Epoch 276
Validation auc = 0.707245
Epoch 277
Validation auc = 0.707790
Epoch 278
Loss = 7.5692e-02, PNorm = 92.9509, GNorm = 1.2565, lr_0 = 9.8756e-04
Validation auc = 0.708281
Epoch 279
Validation auc = 0.704138
Epoch 280
Validation auc = 0.698523
Epoch 281
Validation auc = 0.697650
Epoch 282
Validation auc = 0.686093
Epoch 283
Loss = 2.9251e-02, PNorm = 93.2847, GNorm = 0.4750, lr_0 = 9.8730e-04
Validation auc = 0.683967
Epoch 284
Validation auc = 0.682113
Epoch 285
Validation auc = 0.681186
Epoch 286
Validation auc = 0.681895
Epoch 287
Loss = 7.6077e-02, PNorm = 93.4861, GNorm = 0.4952, lr_0 = 9.8707e-04
Loss = 2.0365e-02, PNorm = 93.5044, GNorm = 0.6362, lr_0 = 9.8705e-04
Validation auc = 0.683421
Epoch 288
Validation auc = 0.685711
Epoch 289
Validation auc = 0.688001
Epoch 290
Validation auc = 0.686802
Epoch 291
Validation auc = 0.688055
Epoch 292
Loss = 4.2794e-02, PNorm = 93.7098, GNorm = 0.7046, lr_0 = 9.8683e-04
Validation auc = 0.687020
Epoch 293
Validation auc = 0.691926
Epoch 294
Validation auc = 0.703102
Epoch 295
Validation auc = 0.716840
Epoch 296
Validation auc = 0.709371
Epoch 297
Loss = 1.6798e-01, PNorm = 94.0421, GNorm = 1.5675, lr_0 = 9.8656e-04
Validation auc = 0.690509
Epoch 298
Validation auc = 0.683094
Epoch 299
Validation auc = 0.666358
Epoch 300
Validation auc = 0.650003
Epoch 301
Loss = 4.1141e-02, PNorm = 94.3278, GNorm = 0.7871, lr_0 = 9.8634e-04
Loss = 6.2775e-03, PNorm = 94.3462, GNorm = 0.1437, lr_0 = 9.8632e-04
Validation auc = 0.637355
Epoch 302
Validation auc = 0.636646
Epoch 303
Validation auc = 0.641007
Epoch 304
Validation auc = 0.657581
Epoch 305
Validation auc = 0.668102
Epoch 306
Loss = 1.4661e-02, PNorm = 94.5390, GNorm = 0.2577, lr_0 = 9.8607e-04
Loss = 7.1324e-03, PNorm = 94.5508, GNorm = 0.1224, lr_0 = 9.8606e-04
Validation auc = 0.674426
Epoch 307
Validation auc = 0.688819
Epoch 308
Validation auc = 0.709862
Epoch 309
Validation auc = 0.710244
Epoch 310
Validation auc = 0.703429
Epoch 311
Loss = 3.9163e-02, PNorm = 94.6763, GNorm = 0.8321, lr_0 = 9.8583e-04
Validation auc = 0.702284
Epoch 312
Validation auc = 0.700812
Epoch 313
Validation auc = 0.699504
Epoch 314
Validation auc = 0.697977
Epoch 315
Validation auc = 0.696996
Epoch 316
Loss = 5.1792e-02, PNorm = 94.7856, GNorm = 0.8220, lr_0 = 9.8557e-04
Validation auc = 0.693289
Epoch 317
Validation auc = 0.690345
Epoch 318
Validation auc = 0.692526
Epoch 319
Validation auc = 0.691817
Epoch 320
Loss = 9.0174e-03, PNorm = 94.8525, GNorm = 0.3081, lr_0 = 9.8534e-04
Loss = 1.6056e-03, PNorm = 94.8588, GNorm = 0.0547, lr_0 = 9.8532e-04
Validation auc = 0.690509
Epoch 321
Validation auc = 0.688546
Epoch 322
Validation auc = 0.687238
Epoch 323
Validation auc = 0.686202
Epoch 324
Validation auc = 0.688382
Epoch 325
Loss = 3.2360e-03, PNorm = 94.9252, GNorm = 0.0516, lr_0 = 9.8509e-04
Validation auc = 0.691872
Epoch 326
Validation auc = 0.696069
Epoch 327
Validation auc = 0.696669
Epoch 328
Validation auc = 0.698577
Epoch 329
Validation auc = 0.695960
Epoch 330
Loss = 6.4161e-03, PNorm = 94.9842, GNorm = 0.1648, lr_0 = 9.8483e-04
Validation auc = 0.692035
Epoch 331
Validation auc = 0.689418
Epoch 332
Validation auc = 0.687619
Epoch 333
Validation auc = 0.688110
Epoch 334
Loss = 2.5299e-03, PNorm = 95.0177, GNorm = 0.0311, lr_0 = 9.8461e-04
Loss = 4.7685e-04, PNorm = 95.0199, GNorm = 0.0121, lr_0 = 9.8459e-04
Validation auc = 0.687292
Epoch 335
Validation auc = 0.687728
Epoch 336
Validation auc = 0.687674
Epoch 337
Validation auc = 0.688492
Epoch 338
Validation auc = 0.689146
Epoch 339
Loss = 2.5926e-03, PNorm = 95.0562, GNorm = 0.0553, lr_0 = 9.8434e-04
Loss = 3.1324e-03, PNorm = 95.0584, GNorm = 0.0846, lr_0 = 9.8433e-04
Validation auc = 0.689527
Epoch 340
Validation auc = 0.689037
Epoch 341
Validation auc = 0.696887
Epoch 342
Validation auc = 0.698632
Epoch 343
Validation auc = 0.698141
Epoch 344
Loss = 2.5710e-03, PNorm = 95.0976, GNorm = 0.0680, lr_0 = 9.8410e-04
Validation auc = 0.695252
Epoch 345
Validation auc = 0.692580
Epoch 346
Validation auc = 0.691926
Epoch 347
Validation auc = 0.689146
Epoch 348
Validation auc = 0.685711
Epoch 349
Loss = 1.4286e-03, PNorm = 95.1644, GNorm = 0.0263, lr_0 = 9.8384e-04
Validation auc = 0.681023
Epoch 350
Validation auc = 0.678024
Epoch 351
Validation auc = 0.676498
Epoch 352
Validation auc = 0.675626
Epoch 353
Loss = 5.2247e-03, PNorm = 95.2034, GNorm = 0.1265, lr_0 = 9.8361e-04
Loss = 1.0652e-03, PNorm = 95.2063, GNorm = 0.0313, lr_0 = 9.8359e-04
Validation auc = 0.676225
Epoch 354
Validation auc = 0.676716
Epoch 355
Validation auc = 0.675789
Epoch 356
Validation auc = 0.677098
Epoch 357
Validation auc = 0.678951
Epoch 358
Loss = 1.6415e-02, PNorm = 95.2976, GNorm = 0.1716, lr_0 = 9.8335e-04
Validation auc = 0.674317
Epoch 359
Validation auc = 0.673827
Epoch 360
Validation auc = 0.670774
Epoch 361
Validation auc = 0.666848
Epoch 362
Validation auc = 0.663795
Epoch 363
Loss = 2.4341e-03, PNorm = 95.4670, GNorm = 0.0483, lr_0 = 9.8311e-04
Validation auc = 0.661669
Epoch 364
Validation auc = 0.648531
Epoch 365
Validation auc = 0.631849
Epoch 366
Validation auc = 0.654746
Epoch 367
Loss = 3.2351e-03, PNorm = 95.5693, GNorm = 0.0238, lr_0 = 9.8288e-04
Loss = 8.3161e-01, PNorm = 95.5745, GNorm = 7.3253, lr_0 = 9.8286e-04
Validation auc = 0.664177
Epoch 368
Validation auc = 0.680914
Epoch 369
Validation auc = 0.697269
Epoch 370
Validation auc = 0.714496
Epoch 371
Validation auc = 0.744698
Epoch 372
Loss = 6.1586e-02, PNorm = 95.8124, GNorm = 0.8170, lr_0 = 9.8262e-04
Loss = 4.9445e-02, PNorm = 95.8335, GNorm = 1.1189, lr_0 = 9.8260e-04
Validation auc = 0.749714
Epoch 373
Validation auc = 0.727689
Epoch 374
Validation auc = 0.702502
Epoch 375
Validation auc = 0.679496
Epoch 376
Validation auc = 0.657417
Epoch 377
Loss = 3.7979e-02, PNorm = 96.0951, GNorm = 0.5499, lr_0 = 9.8237e-04
Validation auc = 0.663250
Epoch 378
Validation auc = 0.686256
Epoch 379
Validation auc = 0.693125
Epoch 380
Validation auc = 0.682331
Epoch 381
Validation auc = 0.692580
Epoch 382
Loss = 1.2548e-02, PNorm = 96.5345, GNorm = 0.2092, lr_0 = 9.8211e-04
Validation auc = 0.697814
Epoch 383
Validation auc = 0.685493
Epoch 384
Validation auc = 0.662269
Epoch 385
Validation auc = 0.682495
Epoch 386
Loss = 2.3162e-02, PNorm = 96.9295, GNorm = 0.2886, lr_0 = 9.8189e-04
Loss = 1.1152e-02, PNorm = 96.9534, GNorm = 0.3209, lr_0 = 9.8187e-04
Validation auc = 0.703593
Epoch 387
Validation auc = 0.714114
Epoch 388
Validation auc = 0.720002
Epoch 389
Validation auc = 0.725454
Epoch 390
Validation auc = 0.731451
Epoch 391
Loss = 2.6150e-02, PNorm = 97.1755, GNorm = 0.0817, lr_0 = 9.8163e-04
Validation auc = 0.734831
Epoch 392
Validation auc = 0.730851
Epoch 393
Validation auc = 0.723655
Epoch 394
Validation auc = 0.716731
Epoch 395
Validation auc = 0.710789
Epoch 396
Loss = 5.5760e-03, PNorm = 97.2819, GNorm = 0.1115, lr_0 = 9.8138e-04
Validation auc = 0.702720
Epoch 397
Validation auc = 0.687619
Epoch 398
Validation auc = 0.682386
Epoch 399
Validation auc = 0.681840
Epoch 400
Loss = 3.1186e-02, PNorm = 97.5004, GNorm = 0.4723, lr_0 = 9.8116e-04
Loss = 3.5785e-03, PNorm = 97.5182, GNorm = 0.0619, lr_0 = 9.8114e-04
Validation auc = 0.680696
Epoch 401
Validation auc = 0.679987
Epoch 402
Validation auc = 0.678733
Epoch 403
Validation auc = 0.678406
Epoch 404
Validation auc = 0.676770
Epoch 405
Loss = 1.8651e-02, PNorm = 97.7020, GNorm = 0.3396, lr_0 = 9.8089e-04
Loss = 1.7131e-03, PNorm = 97.7107, GNorm = 0.0397, lr_0 = 9.8088e-04
Validation auc = 0.675680
Epoch 406
Validation auc = 0.673063
Epoch 407
Validation auc = 0.677098
Epoch 408
Validation auc = 0.683149
Epoch 409
Validation auc = 0.685929
Epoch 410
Loss = 6.7118e-03, PNorm = 97.7959, GNorm = 0.0964, lr_0 = 9.8065e-04
Validation auc = 0.682004
Epoch 411
Validation auc = 0.675080
Epoch 412
Validation auc = 0.669738
Epoch 413
Validation auc = 0.667666
Epoch 414
Validation auc = 0.676280
Epoch 415
Loss = 3.3197e-03, PNorm = 97.8722, GNorm = 0.0583, lr_0 = 9.8039e-04
Validation auc = 0.680696
Epoch 416
Validation auc = 0.681677
Epoch 417
Validation auc = 0.682440
Epoch 418
Validation auc = 0.682331
Epoch 419
Loss = 5.7097e-03, PNorm = 97.9502, GNorm = 0.1064, lr_0 = 9.8016e-04
Loss = 1.1994e-02, PNorm = 97.9562, GNorm = 0.2920, lr_0 = 9.8015e-04
Validation auc = 0.682440
Epoch 420
Validation auc = 0.681950
Epoch 421
Validation auc = 0.683749
Epoch 422
Validation auc = 0.688601
Epoch 423
Validation auc = 0.682277
Epoch 424
Loss = 1.2575e-01, PNorm = 98.1045, GNorm = 3.2003, lr_0 = 9.7990e-04
Validation auc = 0.694052
Epoch 425
Validation auc = 0.698632
Epoch 426
Validation auc = 0.702775
Epoch 427
Validation auc = 0.692689
Epoch 428
Validation auc = 0.679660
Epoch 429
Loss = 1.6097e-02, PNorm = 98.6276, GNorm = 0.4749, lr_0 = 9.7966e-04
Validation auc = 0.663959
Epoch 430
Validation auc = 0.663904
Epoch 431
Validation auc = 0.668320
Epoch 432
Validation auc = 0.672246
Epoch 433
Loss = 1.4214e-02, PNorm = 98.9127, GNorm = 0.3132, lr_0 = 9.7942e-04
Validation auc = 0.667993
Epoch 434
Validation auc = 0.664613
Epoch 435
Validation auc = 0.665976
Epoch 436
Validation auc = 0.666685
Epoch 437
Validation auc = 0.667666
Epoch 438
Loss = 2.0942e-03, PNorm = 99.0273, GNorm = 0.0372, lr_0 = 9.7917e-04
Loss = 1.5744e-03, PNorm = 99.0319, GNorm = 0.0623, lr_0 = 9.7916e-04
Validation auc = 0.667557
Epoch 439
Validation auc = 0.668593
Epoch 440
Validation auc = 0.660470
Epoch 441
Validation auc = 0.654255
Epoch 442
Validation auc = 0.654310
Epoch 443
Loss = 8.5405e-03, PNorm = 99.0827, GNorm = 0.4504, lr_0 = 9.7893e-04
Validation auc = 0.655018
Epoch 444
Validation auc = 0.655073
Epoch 445
Validation auc = 0.657144
Epoch 446
Validation auc = 0.658616
Epoch 447
Validation auc = 0.657581
Epoch 448
Loss = 1.7384e-03, PNorm = 99.1228, GNorm = 0.0506, lr_0 = 9.7867e-04
Validation auc = 0.657635
Epoch 449
Validation auc = 0.657308
Epoch 450
Validation auc = 0.656981
Epoch 451
Validation auc = 0.656981
Epoch 452
Loss = 1.3879e-03, PNorm = 99.1507, GNorm = 0.0244, lr_0 = 9.7845e-04
Loss = 2.5136e-04, PNorm = 99.1524, GNorm = 0.0087, lr_0 = 9.7843e-04
Validation auc = 0.657417
Epoch 453
Validation auc = 0.655400
Epoch 454
Validation auc = 0.656599
Epoch 455
Validation auc = 0.657908
Epoch 456
Validation auc = 0.658889
Epoch 457
Loss = 2.1956e-03, PNorm = 99.1771, GNorm = 0.1465, lr_0 = 9.7819e-04
Loss = 3.2072e-04, PNorm = 99.1786, GNorm = 0.0099, lr_0 = 9.7817e-04
Validation auc = 0.660252
Epoch 458
Validation auc = 0.659761
Epoch 459
Validation auc = 0.658834
Epoch 460
Validation auc = 0.658453
Epoch 461
Validation auc = 0.657635
Epoch 462
Loss = 1.1080e-03, PNorm = 99.2007, GNorm = 0.0200, lr_0 = 9.7794e-04
Validation auc = 0.656926
Epoch 463
Validation auc = 0.656381
Epoch 464
Validation auc = 0.655836
Epoch 465
Validation auc = 0.654691
Epoch 466
Loss = 5.0025e-04, PNorm = 99.2205, GNorm = 0.0133, lr_0 = 9.7770e-04
Validation auc = 0.654909
Epoch 467
Validation auc = 0.654691
Epoch 468
Validation auc = 0.654146
Epoch 469
Validation auc = 0.645314
Epoch 470
Validation auc = 0.635447
Epoch 471
Loss = 1.3504e-02, PNorm = 99.2266, GNorm = 0.6533, lr_0 = 9.7746e-04
Loss = 8.5451e-04, PNorm = 99.2269, GNorm = 0.0241, lr_0 = 9.7744e-04
Validation auc = 0.634084
Epoch 472
Validation auc = 0.642970
Epoch 473
Validation auc = 0.650766
Epoch 474
Validation auc = 0.657253
Epoch 475
Validation auc = 0.660633
Epoch 476
Loss = 5.2364e-04, PNorm = 99.2482, GNorm = 0.0125, lr_0 = 9.7721e-04
Validation auc = 0.661070
Epoch 477
Validation auc = 0.659979
Epoch 478
Validation auc = 0.658889
Epoch 479
Validation auc = 0.658562
Epoch 480
Validation auc = 0.661778
Epoch 481
Loss = 6.0815e-04, PNorm = 99.2768, GNorm = 0.0227, lr_0 = 9.7695e-04
Validation auc = 0.666848
Epoch 482
Validation auc = 0.672736
Epoch 483
Validation auc = 0.675680
Epoch 484
Validation auc = 0.677261
Epoch 485
Loss = 1.0793e-02, PNorm = 99.3104, GNorm = 0.6104, lr_0 = 9.7673e-04
Loss = 9.7699e-02, PNorm = 99.3092, GNorm = 3.3779, lr_0 = 9.7671e-04
Validation auc = 0.671646
Epoch 486
Validation auc = 0.662869
Epoch 487
Validation auc = 0.653001
Epoch 488
Validation auc = 0.646078
Epoch 489
Validation auc = 0.651584
Epoch 490
Loss = 4.0420e-03, PNorm = 99.3705, GNorm = 0.0377, lr_0 = 9.7647e-04
Loss = 6.8078e-04, PNorm = 99.3760, GNorm = 0.0360, lr_0 = 9.7645e-04
Validation auc = 0.663632
Epoch 491
Validation auc = 0.672082
Epoch 492
Validation auc = 0.671210
Epoch 493
Validation auc = 0.661560
Epoch 494
Validation auc = 0.653873
Epoch 495
Loss = 2.1428e-02, PNorm = 99.4461, GNorm = 0.6198, lr_0 = 9.7623e-04
Validation auc = 0.655018
Epoch 496
Validation auc = 0.656109
Epoch 497
Validation auc = 0.652074
Epoch 498
Validation auc = 0.641171
Epoch 499
Loss = 1.7016e-03, PNorm = 99.4992, GNorm = 0.0120, lr_0 = 9.7599e-04
Validation auc = 0.635283
Epoch 500
Validation auc = 0.645696
Epoch 501
Validation auc = 0.657581
Epoch 502
Validation auc = 0.657744
Epoch 503
Validation auc = 0.658344
Epoch 504
Loss = 6.3337e-02, PNorm = 99.7047, GNorm = 2.8147, lr_0 = 9.7574e-04
Loss = 5.7931e-05, PNorm = 99.7241, GNorm = 0.0034, lr_0 = 9.7573e-04
Validation auc = 0.685166
Epoch 505
Validation auc = 0.708390
Epoch 506
Validation auc = 0.705937
Epoch 507
Validation auc = 0.698577
Epoch 508
Validation auc = 0.681404
Epoch 509
Loss = 9.3885e-03, PNorm = 99.9800, GNorm = 0.2970, lr_0 = 9.7550e-04
Validation auc = 0.666249
Epoch 510
Validation auc = 0.658889
Epoch 511
Validation auc = 0.650275
Epoch 512
Validation auc = 0.634684
Epoch 513
Validation auc = 0.620673
Epoch 514
Loss = 5.0564e-03, PNorm = 100.3362, GNorm = 0.1227, lr_0 = 9.7524e-04
Validation auc = 0.633593
Epoch 515
Validation auc = 0.640244
Epoch 516
Validation auc = 0.670065
Epoch 517
Validation auc = 0.678842
Epoch 518
Loss = 1.4018e-01, PNorm = 100.9132, GNorm = 2.2987, lr_0 = 9.7502e-04
Loss = 1.7671e-02, PNorm = 100.9659, GNorm = 0.4750, lr_0 = 9.7500e-04
Validation auc = 0.685602
Epoch 519
Validation auc = 0.698032
Epoch 520
Validation auc = 0.703811
Epoch 521
Validation auc = 0.711280
Epoch 522
Validation auc = 0.717985
Epoch 523
Loss = 1.9880e-02, PNorm = 101.5443, GNorm = 0.1146, lr_0 = 9.7476e-04
Loss = 2.2463e-03, PNorm = 101.5705, GNorm = 0.0568, lr_0 = 9.7474e-04
Validation auc = 0.719457
Epoch 524
Validation auc = 0.718258
Epoch 525
Validation auc = 0.714714
Epoch 526
Validation auc = 0.715150
Epoch 527
Validation auc = 0.712043
Epoch 528
Loss = 1.7270e-02, PNorm = 101.7804, GNorm = 0.4464, lr_0 = 9.7452e-04
Validation auc = 0.708009
Epoch 529
Validation auc = 0.701412
Epoch 530
Validation auc = 0.699722
Epoch 531
Validation auc = 0.699722
Epoch 532
Validation auc = 0.702938
Epoch 533
Loss = 2.8681e-02, PNorm = 101.9654, GNorm = 0.7165, lr_0 = 9.7426e-04
Validation auc = 0.715205
Epoch 534
Validation auc = 0.710571
Epoch 535
Validation auc = 0.700594
Epoch 536
Validation auc = 0.684566
Epoch 537
Loss = 1.4887e-02, PNorm = 102.1459, GNorm = 0.5058, lr_0 = 9.7403e-04
Loss = 9.3978e-04, PNorm = 102.1591, GNorm = 0.0248, lr_0 = 9.7401e-04
Validation auc = 0.667175
Epoch 538
Validation auc = 0.648367
Epoch 539
Validation auc = 0.634847
Epoch 540
Validation auc = 0.618274
Epoch 541
Validation auc = 0.609224
Epoch 542
Loss = 5.7775e-03, PNorm = 102.2942, GNorm = 0.1580, lr_0 = 9.7379e-04
Validation auc = 0.612114
Epoch 543
Validation auc = 0.624216
Epoch 544
Validation auc = 0.633103
Epoch 545
Validation auc = 0.637845
Epoch 546
Validation auc = 0.640898
Epoch 547
Loss = 3.7709e-03, PNorm = 102.3969, GNorm = 0.0827, lr_0 = 9.7353e-04
Validation auc = 0.642425
Epoch 548
Validation auc = 0.640408
Epoch 549
Validation auc = 0.638500
Epoch 550
Validation auc = 0.636101
Epoch 551
Loss = 5.8434e-02, PNorm = 102.4478, GNorm = 0.0100, lr_0 = 9.7331e-04
Loss = 2.9009e-04, PNorm = 102.4490, GNorm = 0.0111, lr_0 = 9.7329e-04
Validation auc = 0.630050
Epoch 552
Validation auc = 0.625252
Epoch 553
Validation auc = 0.624216
Epoch 554
Validation auc = 0.627160
Epoch 555
Validation auc = 0.632666
Epoch 556
Loss = 1.4038e-03, PNorm = 102.4817, GNorm = 0.0193, lr_0 = 9.7305e-04
Loss = 1.0878e-03, PNorm = 102.4842, GNorm = 0.0501, lr_0 = 9.7303e-04
Validation auc = 0.636919
Epoch 557
Validation auc = 0.638500
Epoch 558
Validation auc = 0.646350
Epoch 559
Validation auc = 0.662814
Epoch 560
Validation auc = 0.668866
Epoch 561
Loss = 3.6338e-03, PNorm = 102.5364, GNorm = 0.1129, lr_0 = 9.7281e-04
Validation auc = 0.667121
Epoch 562
Validation auc = 0.657144
Epoch 563
Validation auc = 0.655563
Epoch 564
Validation auc = 0.655127
Epoch 565
Validation auc = 0.647713
Epoch 566
Loss = 5.4464e-02, PNorm = 102.6520, GNorm = 1.3736, lr_0 = 9.7255e-04
Validation auc = 0.637791
Epoch 567
Validation auc = 0.627487
Epoch 568
Validation auc = 0.580330
Epoch 569
Validation auc = 0.595868
Epoch 570
Loss = 1.1998e-01, PNorm = 102.7868, GNorm = 0.7825, lr_0 = 9.7232e-04
Loss = 1.0277e-04, PNorm = 102.8052, GNorm = 0.0036, lr_0 = 9.7231e-04
Validation auc = 0.688764
Epoch 571
Validation auc = 0.718530
Epoch 572
Validation auc = 0.731723
Epoch 573
Validation auc = 0.739356
Epoch 574
Validation auc = 0.745843
Epoch 575
Loss = 5.4035e-02, PNorm = 102.9933, GNorm = 1.0686, lr_0 = 9.7208e-04
Validation auc = 0.748569
Epoch 576
Validation auc = 0.745898
Epoch 577
Validation auc = 0.744426
Epoch 578
Validation auc = 0.741591
Epoch 579
Validation auc = 0.739628
Epoch 580
Loss = 6.3835e-02, PNorm = 103.1066, GNorm = 0.7299, lr_0 = 9.7182e-04
Validation auc = 0.736739
Epoch 581
Validation auc = 0.736030
Epoch 582
Validation auc = 0.734504
Epoch 583
Validation auc = 0.738320
Epoch 584
Loss = 1.7799e-02, PNorm = 103.1571, GNorm = 0.3429, lr_0 = 9.7160e-04
Loss = 2.2460e-02, PNorm = 103.1641, GNorm = 0.8355, lr_0 = 9.7158e-04
Validation auc = 0.736248
Epoch 585
Validation auc = 0.733141
Epoch 586
Validation auc = 0.728725
Epoch 587
Validation auc = 0.724091
Epoch 588
Validation auc = 0.721420
Epoch 589
Loss = 1.2447e-03, PNorm = 103.2580, GNorm = 0.0190, lr_0 = 9.7134e-04
Loss = 1.2516e-04, PNorm = 103.2623, GNorm = 0.0048, lr_0 = 9.7132e-04
Validation auc = 0.718367
Epoch 590
Validation auc = 0.721202
Epoch 591
Validation auc = 0.720111
Epoch 592
Validation auc = 0.721856
Epoch 593
Validation auc = 0.724254
Epoch 594
Loss = 1.8292e-03, PNorm = 103.3068, GNorm = 0.0370, lr_0 = 9.7110e-04
Validation auc = 0.725890
Epoch 595
Validation auc = 0.726326
Epoch 596
Validation auc = 0.727307
Epoch 597
Validation auc = 0.728452
Epoch 598
Validation auc = 0.728997
Epoch 599
Loss = 8.3053e-02, PNorm = 103.3341, GNorm = 0.4523, lr_0 = 9.7084e-04
Validation auc = 0.727853
Epoch 600
Validation auc = 0.725781
Epoch 601
Validation auc = 0.724800
Epoch 602
Validation auc = 0.723491
Epoch 603
Loss = 1.6475e-03, PNorm = 103.3436, GNorm = 0.0163, lr_0 = 9.7062e-04
Loss = 5.0660e-04, PNorm = 103.3454, GNorm = 0.0141, lr_0 = 9.7060e-04
Validation auc = 0.722619
Epoch 604
Validation auc = 0.720820
Epoch 605
Validation auc = 0.721583
Epoch 606
Validation auc = 0.717985
Epoch 607
Validation auc = 0.706155
Epoch 608
Loss = 4.4803e-02, PNorm = 103.4082, GNorm = 1.4558, lr_0 = 9.7036e-04
Validation auc = 0.697977
Epoch 609
Validation auc = 0.693453
Epoch 610
Validation auc = 0.688219
Epoch 611
Validation auc = 0.683749
Epoch 612
Validation auc = 0.679605
Epoch 613
Loss = 4.6505e-03, PNorm = 103.5468, GNorm = 0.2216, lr_0 = 9.7012e-04
Validation auc = 0.677207
Epoch 614
Validation auc = 0.678351
Epoch 615
Validation auc = 0.663523
Epoch 616
Validation auc = 0.648694
Epoch 617
Loss = 1.0263e-02, PNorm = 103.6745, GNorm = 0.7929, lr_0 = 9.6990e-04
Loss = 7.7870e-01, PNorm = 103.7130, GNorm = 11.9280, lr_0 = 9.6988e-04
Validation auc = 0.702339
Epoch 618
Validation auc = 0.738592
Epoch 619
Validation auc = 0.694161
Epoch 620
Validation auc = 0.655563
Epoch 621
Validation auc = 0.636428
Epoch 622
Loss = 5.6282e-02, PNorm = 104.5317, GNorm = 1.1647, lr_0 = 9.6964e-04
Loss = 2.0058e-02, PNorm = 104.5764, GNorm = 0.5928, lr_0 = 9.6962e-04
Validation auc = 0.628251
Epoch 623
Validation auc = 0.649676
Epoch 624
Validation auc = 0.668702
Epoch 625
Validation auc = 0.674099
Epoch 626
Validation auc = 0.679932
Epoch 627
Loss = 5.6381e-02, PNorm = 104.9781, GNorm = 0.3680, lr_0 = 9.6940e-04
Validation auc = 0.684239
Epoch 628
Validation auc = 0.685548
Epoch 629
Validation auc = 0.685657
Epoch 630
Validation auc = 0.688601
Epoch 631
Validation auc = 0.688328
Epoch 632
Loss = 2.6123e-02, PNorm = 105.2006, GNorm = 0.7355, lr_0 = 9.6914e-04
Validation auc = 0.685984
Epoch 633
Validation auc = 0.685384
Epoch 634
Validation auc = 0.680859
Epoch 635
Validation auc = 0.661887
Epoch 636
Loss = 2.8913e-02, PNorm = 105.3077, GNorm = 0.6651, lr_0 = 9.6892e-04
Loss = 1.1372e-02, PNorm = 105.3159, GNorm = 0.4126, lr_0 = 9.6890e-04
Validation auc = 0.660088
Epoch 637
Validation auc = 0.659979
Epoch 638
Validation auc = 0.664504
Epoch 639
Validation auc = 0.668048
Epoch 640
Validation auc = 0.669574
Epoch 641
Loss = 2.6410e-03, PNorm = 105.4196, GNorm = 0.0271, lr_0 = 9.6866e-04
Validation auc = 0.666957
Epoch 642
Validation auc = 0.663795
Epoch 643
Validation auc = 0.659870
Epoch 644
Validation auc = 0.657253
Epoch 645
Validation auc = 0.657090
Epoch 646
Loss = 1.2276e-03, PNorm = 105.4666, GNorm = 0.0318, lr_0 = 9.6842e-04
Validation auc = 0.655018
Epoch 647
Validation auc = 0.653982
Epoch 648
Validation auc = 0.654310
Epoch 649
Validation auc = 0.655073
Epoch 650
Loss = 5.6025e-02, PNorm = 105.4969, GNorm = 0.1361, lr_0 = 9.6820e-04
Loss = 1.4303e-03, PNorm = 105.4976, GNorm = 0.0572, lr_0 = 9.6818e-04
Validation auc = 0.656490
Epoch 651
Validation auc = 0.657799
Epoch 652
Validation auc = 0.659543
Epoch 653
Validation auc = 0.656000
Epoch 654
Validation auc = 0.651475
Epoch 655
Loss = 1.1470e-02, PNorm = 105.5355, GNorm = 0.6560, lr_0 = 9.6794e-04
Loss = 9.9147e-02, PNorm = 105.5365, GNorm = 6.1040, lr_0 = 9.6792e-04
Validation auc = 0.660906
Epoch 656
Validation auc = 0.678842
Epoch 657
Validation auc = 0.680696
Epoch 658
Validation auc = 0.677152
Epoch 659
Validation auc = 0.673336
Epoch 660
Loss = 3.1749e-03, PNorm = 105.6313, GNorm = 0.0758, lr_0 = 9.6770e-04
Validation auc = 0.670228
Epoch 661
Validation auc = 0.668756
Epoch 662
Validation auc = 0.668920
Epoch 663
Validation auc = 0.669792
Epoch 664
Validation auc = 0.669247
Epoch 665
Loss = 1.7926e-02, PNorm = 105.7183, GNorm = 0.5664, lr_0 = 9.6744e-04
Validation auc = 0.666085
Epoch 666
Validation auc = 0.662433
Epoch 667
Validation auc = 0.661724
Epoch 668
Validation auc = 0.663632
Epoch 669
Loss = 5.0991e-03, PNorm = 105.7885, GNorm = 0.0627, lr_0 = 9.6722e-04
Loss = 2.8322e-03, PNorm = 105.7971, GNorm = 0.0682, lr_0 = 9.6720e-04
Validation auc = 0.666739
Epoch 670
Validation auc = 0.666685
Epoch 671
Validation auc = 0.665813
Epoch 672
Validation auc = 0.664722
Epoch 673
Validation auc = 0.664995
Epoch 674
Loss = 1.3633e-03, PNorm = 105.8834, GNorm = 0.0094, lr_0 = 9.6696e-04
Validation auc = 0.665540
Epoch 675
Validation auc = 0.667175
Epoch 676
Validation auc = 0.669138
Epoch 677
Validation auc = 0.670119
Epoch 678
Validation auc = 0.670719
Epoch 679
Loss = 1.8351e-03, PNorm = 105.9301, GNorm = 0.0643, lr_0 = 9.6672e-04
Validation auc = 0.656163
Epoch 680
Validation auc = 0.636864
Epoch 681
Validation auc = 0.645805
Epoch 682
Validation auc = 0.658834
Epoch 683
Loss = 4.0483e-03, PNorm = 105.9630, GNorm = 0.1244, lr_0 = 9.6648e-04
Validation auc = 0.663032
Epoch 684
Validation auc = 0.665049
Epoch 685
Validation auc = 0.665213
Epoch 686
Validation auc = 0.667503
Epoch 687
Validation auc = 0.667175
Epoch 688
Loss = 2.1165e-02, PNorm = 106.0074, GNorm = 0.0333, lr_0 = 9.6624e-04
Loss = 3.6194e-04, PNorm = 106.0106, GNorm = 0.0109, lr_0 = 9.6622e-04
Validation auc = 0.657635
Epoch 689
Validation auc = 0.643461
Epoch 690
Validation auc = 0.630322
Epoch 691
Validation auc = 0.619746
Epoch 692
Validation auc = 0.617947
Epoch 693
Loss = 2.9451e-03, PNorm = 106.0554, GNorm = 0.1247, lr_0 = 9.6600e-04
Validation auc = 0.622962
Epoch 694
Validation auc = 0.633266
Epoch 695
Validation auc = 0.638718
Epoch 696
Validation auc = 0.640244
Epoch 697
Validation auc = 0.632612
Epoch 698
Loss = 5.3285e-04, PNorm = 106.1037, GNorm = 0.0324, lr_0 = 9.6574e-04
Validation auc = 0.634902
Epoch 699
Validation auc = 0.646841
Epoch 700
Validation auc = 0.654909
Epoch 701
Validation auc = 0.652238
Epoch 702
Loss = 8.0209e-03, PNorm = 106.3756, GNorm = 0.2603, lr_0 = 9.6552e-04
Loss = 2.1137e-03, PNorm = 106.3954, GNorm = 0.0812, lr_0 = 9.6550e-04
Validation auc = 0.646786
Epoch 703
Validation auc = 0.673990
Epoch 704
Validation auc = 0.693780
Epoch 705
Validation auc = 0.692253
Epoch 706
Validation auc = 0.682658
Epoch 707
Loss = 2.7294e-02, PNorm = 106.6594, GNorm = 1.5036, lr_0 = 9.6526e-04
Loss = 4.7948e-03, PNorm = 106.6743, GNorm = 0.1828, lr_0 = 9.6525e-04
Validation auc = 0.682059
Epoch 708
Validation auc = 0.675353
Epoch 709
Validation auc = 0.671373
Epoch 710
Validation auc = 0.671700
Epoch 711
Validation auc = 0.671264
Epoch 712
Loss = 3.6991e-03, PNorm = 106.8123, GNorm = 0.0964, lr_0 = 9.6502e-04
Validation auc = 0.672082
Epoch 713
Validation auc = 0.672573
Epoch 714
Validation auc = 0.674808
Epoch 715
Validation auc = 0.675080
Epoch 716
Loss = 1.2846e-03, PNorm = 106.8878, GNorm = 0.0721, lr_0 = 9.6479e-04
Validation auc = 0.673936
Epoch 717
Validation auc = 0.674263
Epoch 718
Validation auc = 0.668702
Epoch 719
Validation auc = 0.655018
Epoch 720
Validation auc = 0.606008
Epoch 721
Loss = 6.5609e-02, PNorm = 107.0714, GNorm = 0.8335, lr_0 = 9.6455e-04
Loss = 1.1639e-03, PNorm = 107.1063, GNorm = 0.0667, lr_0 = 9.6453e-04
Validation auc = 0.599847
Epoch 722
Validation auc = 0.620509
Epoch 723
Validation auc = 0.612168
Epoch 724
Validation auc = 0.601755
Epoch 725
Validation auc = 0.603118
Epoch 726
Loss = 4.9126e-02, PNorm = 107.6191, GNorm = 0.9240, lr_0 = 9.6431e-04
Validation auc = 0.617020
Epoch 727
Validation auc = 0.628850
Epoch 728
Validation auc = 0.643079
Epoch 729
Validation auc = 0.653274
Epoch 730
Validation auc = 0.665976
Epoch 731
Loss = 5.5238e-03, PNorm = 108.1059, GNorm = 0.1534, lr_0 = 9.6405e-04
Validation auc = 0.676334
Epoch 732
Validation auc = 0.683476
Epoch 733
Validation auc = 0.687129
Epoch 734
Validation auc = 0.690672
Epoch 735
Loss = 1.8230e-03, PNorm = 108.3156, GNorm = 0.0628, lr_0 = 9.6383e-04
Loss = 1.4305e-03, PNorm = 108.3252, GNorm = 0.0632, lr_0 = 9.6381e-04
Validation auc = 0.691872
Epoch 736
Validation auc = 0.692253
Epoch 737
Validation auc = 0.693234
Epoch 738
Validation auc = 0.694870
Epoch 739
Validation auc = 0.697432
Epoch 740
Loss = 2.4977e-02, PNorm = 108.4159, GNorm = 0.0202, lr_0 = 9.6357e-04
Loss = 1.7171e-04, PNorm = 108.4211, GNorm = 0.0074, lr_0 = 9.6355e-04
Validation auc = 0.705228
Epoch 741
Validation auc = 0.710407
Epoch 742
Validation auc = 0.711443
Epoch 743
Validation auc = 0.711661
Epoch 744
Validation auc = 0.712588
Epoch 745
Loss = 5.5588e-02, PNorm = 108.4956, GNorm = 1.1686, lr_0 = 9.6333e-04
Validation auc = 0.713133
Epoch 746
Validation auc = 0.713297
Epoch 747
Validation auc = 0.711334
Epoch 748
Validation auc = 0.708118
Epoch 749
Loss = 3.5068e-03, PNorm = 108.5764, GNorm = 0.0793, lr_0 = 9.6309e-04
Validation auc = 0.705337
Epoch 750
Validation auc = 0.701030
Epoch 751
Validation auc = 0.699286
Epoch 752
Validation auc = 0.697759
Epoch 753
Validation auc = 0.696069
Epoch 754
Loss = 1.1176e-03, PNorm = 108.6290, GNorm = 0.0148, lr_0 = 9.6285e-04
Loss = 7.5856e-04, PNorm = 108.6315, GNorm = 0.0330, lr_0 = 9.6284e-04
Validation auc = 0.694706
Epoch 755
Validation auc = 0.693889
Epoch 756
Validation auc = 0.697977
Epoch 757
Validation auc = 0.701576
Epoch 758
Validation auc = 0.703102
Epoch 759
Loss = 2.6193e-03, PNorm = 108.6495, GNorm = 0.1024, lr_0 = 9.6262e-04
Validation auc = 0.701576
Epoch 760
Validation auc = 0.699995
Epoch 761
Validation auc = 0.696833
Epoch 762
Validation auc = 0.693234
Epoch 763
Validation auc = 0.689691
Epoch 764
Loss = 2.2108e-03, PNorm = 108.6957, GNorm = 0.1029, lr_0 = 9.6236e-04
Validation auc = 0.686692
Epoch 765
Validation auc = 0.684185
Epoch 766
Validation auc = 0.681895
Epoch 767
Validation auc = 0.680423
Epoch 768
Loss = 3.7801e-04, PNorm = 108.7187, GNorm = 0.0151, lr_0 = 9.6214e-04
Loss = 5.1655e-04, PNorm = 108.7198, GNorm = 0.0158, lr_0 = 9.6212e-04
Validation auc = 0.678569
Epoch 769
Validation auc = 0.678406
Epoch 770
Validation auc = 0.672627
Epoch 771
Validation auc = 0.667939
Epoch 772
Validation auc = 0.677316
Epoch 773
Loss = 7.7024e-04, PNorm = 108.7342, GNorm = 0.0148, lr_0 = 9.6188e-04
Loss = 9.6919e-05, PNorm = 108.7350, GNorm = 0.0052, lr_0 = 9.6186e-04
Validation auc = 0.681731
Epoch 774
Validation auc = 0.680750
Epoch 775
Validation auc = 0.669683
Epoch 776
Validation auc = 0.666685
Epoch 777
Validation auc = 0.666903
Epoch 778
Loss = 1.4608e-04, PNorm = 108.7483, GNorm = 0.0029, lr_0 = 9.6164e-04
Validation auc = 0.668866
Epoch 779
Validation auc = 0.673608
Epoch 780
Validation auc = 0.682495
Epoch 781
Validation auc = 0.692308
Epoch 782
Validation auc = 0.697868
Epoch 783
Loss = 4.5848e-03, PNorm = 108.8096, GNorm = 0.1699, lr_0 = 9.6139e-04
Validation auc = 0.703047
Epoch 784
Validation auc = 0.703920
Epoch 785
Validation auc = 0.704301
Epoch 786
Validation auc = 0.714878
Epoch 787
Loss = 7.0149e-03, PNorm = 108.9296, GNorm = 0.0238, lr_0 = 9.6117e-04
Loss = 4.3306e-04, PNorm = 108.9477, GNorm = 0.0196, lr_0 = 9.6115e-04
Validation auc = 0.720438
Epoch 788
Validation auc = 0.712751
Epoch 789
Validation auc = 0.673281
Epoch 790
Validation auc = 0.668429
Epoch 791
Validation auc = 0.667175
Epoch 792
Loss = 3.1441e-01, PNorm = 109.5628, GNorm = 7.0766, lr_0 = 9.6093e-04
Validation auc = 0.712043
Epoch 793
Validation auc = 0.725781
Epoch 794
Validation auc = 0.723655
Epoch 795
Validation auc = 0.718639
Epoch 796
Validation auc = 0.713515
Epoch 797
Loss = 2.9390e-02, PNorm = 110.4063, GNorm = 0.4637, lr_0 = 9.6067e-04
Validation auc = 0.703075
Epoch 798
Validation auc = 0.690863
Epoch 799
Validation auc = 0.691245
Epoch 800
Validation auc = 0.691272
Epoch 801
Loss = 7.5248e-02, PNorm = 110.6902, GNorm = 1.9662, lr_0 = 9.6045e-04
Loss = 4.7554e-01, PNorm = 110.7125, GNorm = 15.9740, lr_0 = 9.6043e-04
Validation auc = 0.701903
Epoch 802
Validation auc = 0.686066
Epoch 803
Validation auc = 0.699749
Epoch 804
Validation auc = 0.711443
Epoch 805
Validation auc = 0.727962
Epoch 806
Loss = 9.9153e-02, PNorm = 111.5396, GNorm = 2.6886, lr_0 = 9.6019e-04
Loss = 9.8712e-02, PNorm = 111.6140, GNorm = 4.6096, lr_0 = 9.6018e-04
Validation auc = 0.717767
Epoch 807
Validation auc = 0.667121
Epoch 808
Validation auc = 0.660088
Epoch 809
Validation auc = 0.652783
Epoch 810
Validation auc = 0.656163
Epoch 811
Loss = 2.8779e-02, PNorm = 112.5834, GNorm = 0.8150, lr_0 = 9.5996e-04
Validation auc = 0.657144
Epoch 812
Validation auc = 0.669193
Epoch 813
Validation auc = 0.657581
Epoch 814
Validation auc = 0.631576
Epoch 815
Validation auc = 0.627978
Epoch 816
Loss = 5.1031e-02, PNorm = 113.2187, GNorm = 1.8318, lr_0 = 9.5970e-04
Validation auc = 0.628741
Epoch 817
Validation auc = 0.658017
Epoch 818
Validation auc = 0.672464
Epoch 819
Validation auc = 0.662214
Epoch 820
Loss = 5.1064e-02, PNorm = 113.7959, GNorm = 0.7636, lr_0 = 9.5948e-04
Loss = 4.7506e-03, PNorm = 113.8330, GNorm = 0.1135, lr_0 = 9.5946e-04
Validation auc = 0.648858
Epoch 821
Validation auc = 0.638827
Epoch 822
Validation auc = 0.632666
Epoch 823
Validation auc = 0.623235
Epoch 824
Validation auc = 0.620291
Epoch 825
Loss = 1.6385e-02, PNorm = 114.2308, GNorm = 0.2166, lr_0 = 9.5924e-04
Validation auc = 0.622853
Epoch 826
Validation auc = 0.625852
Epoch 827
Validation auc = 0.627433
Epoch 828
Validation auc = 0.624707
Epoch 829
Validation auc = 0.621872
Epoch 830
Loss = 1.3780e-02, PNorm = 114.4719, GNorm = 0.2290, lr_0 = 9.5899e-04
Validation auc = 0.620237
Epoch 831
Validation auc = 0.623290
Epoch 832
Validation auc = 0.627978
Epoch 833
Validation auc = 0.631576
Epoch 834
Loss = 1.1263e-01, PNorm = 114.5909, GNorm = 0.0921, lr_0 = 9.5877e-04
Loss = 8.3960e-03, PNorm = 114.6007, GNorm = 0.4142, lr_0 = 9.5875e-04
Validation auc = 0.631249
Epoch 835
Validation auc = 0.636265
Epoch 836
Validation auc = 0.639972
Epoch 837
Validation auc = 0.652729
Epoch 838
Validation auc = 0.663468
Epoch 839
Loss = 7.6755e-03, PNorm = 114.7251, GNorm = 0.1126, lr_0 = 9.5851e-04
Loss = 1.4264e-02, PNorm = 114.7398, GNorm = 0.3275, lr_0 = 9.5849e-04
Validation auc = 0.672300
Epoch 840
Validation auc = 0.674045
Epoch 841
Validation auc = 0.672027
Epoch 842
Validation auc = 0.668702
Epoch 843
Validation auc = 0.666685
Epoch 844
Loss = 2.5333e-03, PNorm = 114.8556, GNorm = 0.0429, lr_0 = 9.5827e-04
Validation auc = 0.666358
Epoch 845
Validation auc = 0.666630
Epoch 846
Validation auc = 0.668157
Epoch 847
Validation auc = 0.670828
Epoch 848
Validation auc = 0.671591
Epoch 849
Loss = 6.3220e-02, PNorm = 114.9397, GNorm = 0.7537, lr_0 = 9.5802e-04
Validation auc = 0.670828
Epoch 850
Validation auc = 0.669738
Epoch 851
Validation auc = 0.665922
Epoch 852
Validation auc = 0.663196
Epoch 853
Loss = 3.4625e-03, PNorm = 114.9774, GNorm = 0.0912, lr_0 = 9.5780e-04
Loss = 9.6305e-04, PNorm = 114.9787, GNorm = 0.0257, lr_0 = 9.5778e-04
Validation auc = 0.660906
Epoch 854
Validation auc = 0.658889
Epoch 855
Validation auc = 0.659652
Epoch 856
Validation auc = 0.661070
Epoch 857
Validation auc = 0.657472
Epoch 858
Loss = 7.9423e-03, PNorm = 115.0423, GNorm = 0.1470, lr_0 = 9.5754e-04
Validation auc = 0.651693
Epoch 859
Validation auc = 0.644169
Epoch 860
Validation auc = 0.640680
Epoch 861
Validation auc = 0.638881
Epoch 862
Validation auc = 0.639645
Epoch 863
Loss = 1.4588e-02, PNorm = 115.1372, GNorm = 0.2793, lr_0 = 9.5730e-04
Validation auc = 0.639917
Epoch 864
Validation auc = 0.639317
Epoch 865
Validation auc = 0.637464
Epoch 866
Validation auc = 0.635229
Epoch 867
Loss = 9.9306e-03, PNorm = 115.2148, GNorm = 0.0766, lr_0 = 9.5708e-04
Loss = 6.4108e-05, PNorm = 115.2186, GNorm = 0.0022, lr_0 = 9.5707e-04
Validation auc = 0.634084
Epoch 868
Validation auc = 0.634793
Epoch 869
Validation auc = 0.636537
Epoch 870
Validation auc = 0.640898
Epoch 871
Validation auc = 0.643570
Epoch 872
Loss = 3.9454e-03, PNorm = 115.2872, GNorm = 0.0794, lr_0 = 9.5683e-04
Loss = 3.8867e-04, PNorm = 115.2905, GNorm = 0.0149, lr_0 = 9.5681e-04
Validation auc = 0.645750
Epoch 873
Validation auc = 0.650602
Epoch 874
Validation auc = 0.652674
Epoch 875
Validation auc = 0.652456
Epoch 876
Validation auc = 0.652074
Epoch 877
Loss = 1.6659e-03, PNorm = 115.3372, GNorm = 0.0275, lr_0 = 9.5659e-04
Validation auc = 0.642752
Epoch 878
Validation auc = 0.621054
Epoch 879
Validation auc = 0.605735
Epoch 880
Validation auc = 0.627705
Epoch 881
Validation auc = 0.648422
Epoch 882
Loss = 1.5145e-03, PNorm = 115.3907, GNorm = 0.0395, lr_0 = 9.5634e-04
Validation auc = 0.655018
Epoch 883
Validation auc = 0.652020
Epoch 884
Validation auc = 0.650875
Epoch 885
Validation auc = 0.653601
Epoch 886
Loss = 2.5195e-02, PNorm = 115.5524, GNorm = 0.7577, lr_0 = 9.5612e-04
Loss = 7.0605e-05, PNorm = 115.5642, GNorm = 0.0022, lr_0 = 9.5610e-04
Validation auc = 0.657799
Epoch 887
Validation auc = 0.659979
Epoch 888
Validation auc = 0.660579
Epoch 889
Validation auc = 0.662214
Epoch 890
Validation auc = 0.664123
Epoch 891
Loss = 3.2042e-03, PNorm = 115.7374, GNorm = 0.1374, lr_0 = 9.5586e-04
Validation auc = 0.662433
Epoch 892
Validation auc = 0.663305
Epoch 893
Validation auc = 0.658998
Epoch 894
Validation auc = 0.651529
Epoch 895
Validation auc = 0.646078
Epoch 896
Loss = 2.8737e-03, PNorm = 115.8489, GNorm = 0.1214, lr_0 = 9.5563e-04
Validation auc = 0.644878
Epoch 897
Validation auc = 0.643243
Epoch 898
Validation auc = 0.643079
Epoch 899
Validation auc = 0.641934
Epoch 900
Loss = 2.9183e-03, PNorm = 115.9315, GNorm = 0.0585, lr_0 = 9.5541e-04
Loss = 8.2027e-03, PNorm = 115.9385, GNorm = 0.3487, lr_0 = 9.5539e-04
Validation auc = 0.642370
Epoch 901
Validation auc = 0.644115
Epoch 902
Validation auc = 0.642752
Epoch 903
Validation auc = 0.638990
Epoch 904
Validation auc = 0.638500
Epoch 905
Loss = 3.7854e-02, PNorm = 116.0665, GNorm = 0.2000, lr_0 = 9.5515e-04
Loss = 1.8997e-03, PNorm = 116.0784, GNorm = 0.0692, lr_0 = 9.5513e-04
Validation auc = 0.638663
Epoch 906
Validation auc = 0.646841
Epoch 907
Validation auc = 0.641335
Epoch 908
Validation auc = 0.642479
Epoch 909
Validation auc = 0.656490
Epoch 910
Loss = 1.2482e-01, PNorm = 116.3867, GNorm = 0.9032, lr_0 = 9.5491e-04
Validation auc = 0.667666
Epoch 911
Validation auc = 0.664831
Epoch 912
Validation auc = 0.661288
Epoch 913
Validation auc = 0.659652
Epoch 914
Validation auc = 0.660361
Epoch 915
Loss = 3.8643e-02, PNorm = 116.7260, GNorm = 0.8146, lr_0 = 9.5466e-04
Validation auc = 0.663032
Epoch 916
Validation auc = 0.668320
Epoch 917
Validation auc = 0.666412
Epoch 918
Validation auc = 0.663577
Epoch 919
Loss = 8.5798e-03, PNorm = 116.8830, GNorm = 0.2452, lr_0 = 9.5444e-04
Loss = 3.1787e-03, PNorm = 116.8905, GNorm = 0.1993, lr_0 = 9.5442e-04
Validation auc = 0.660688
Epoch 920
Validation auc = 0.655291
Epoch 921
Validation auc = 0.651747
Epoch 922
Validation auc = 0.649894
Epoch 923
Validation auc = 0.647768
Epoch 924
Loss = 2.4263e-03, PNorm = 116.9540, GNorm = 0.0822, lr_0 = 9.5419e-04
Validation auc = 0.645478
Epoch 925
Validation auc = 0.643842
Epoch 926
Validation auc = 0.643406
Epoch 927
Validation auc = 0.643733
Epoch 928
Validation auc = 0.643352
Epoch 929
Loss = 1.3805e-03, PNorm = 116.9792, GNorm = 0.0687, lr_0 = 9.5395e-04
Validation auc = 0.642752
Epoch 930
Validation auc = 0.643733
Epoch 931
Validation auc = 0.644987
Epoch 932
Validation auc = 0.646623
Epoch 933
Loss = 2.0042e-02, PNorm = 116.9941, GNorm = 0.0943, lr_0 = 9.5371e-04
Validation auc = 0.651802
Epoch 934
Validation auc = 0.655400
Epoch 935
Validation auc = 0.657853
Epoch 936
Validation auc = 0.661233
Epoch 937
Validation auc = 0.660743
Epoch 938
Loss = 4.0402e-03, PNorm = 117.0151, GNorm = 0.0293, lr_0 = 9.5348e-04
Loss = 1.3154e-03, PNorm = 117.0163, GNorm = 0.0425, lr_0 = 9.5346e-04
Validation auc = 0.657908
Epoch 939
Validation auc = 0.655509
Epoch 940
Validation auc = 0.653001
Epoch 941
Validation auc = 0.651039
Epoch 942
Validation auc = 0.647440
Epoch 943
Loss = 4.3055e-02, PNorm = 117.0353, GNorm = 0.7816, lr_0 = 9.5324e-04
Validation auc = 0.639808
Epoch 944
Validation auc = 0.630922
Epoch 945
Validation auc = 0.625961
Epoch 946
Validation auc = 0.632230
Epoch 947
Validation auc = 0.649349
Epoch 948
Loss = 3.4108e-03, PNorm = 117.0928, GNorm = 0.0726, lr_0 = 9.5299e-04
Validation auc = 0.667448
Epoch 949
Validation auc = 0.668429
Epoch 950
Validation auc = 0.661833
Epoch 951
Validation auc = 0.656218
Epoch 952
Loss = 3.2404e-03, PNorm = 117.3376, GNorm = 0.0388, lr_0 = 9.5277e-04
Loss = 2.5428e-04, PNorm = 117.3533, GNorm = 0.0075, lr_0 = 9.5275e-04
Validation auc = 0.654255
Epoch 953
Validation auc = 0.651584
Epoch 954
Validation auc = 0.648585
Epoch 955
Validation auc = 0.646350
Epoch 956
Validation auc = 0.641880
Epoch 957
Loss = 4.8793e-03, PNorm = 117.4961, GNorm = 0.1333, lr_0 = 9.5251e-04
Loss = 1.1576e-02, PNorm = 117.5024, GNorm = 0.7538, lr_0 = 9.5250e-04
Validation auc = 0.639863
Epoch 958
Validation auc = 0.649730
Epoch 959
Validation auc = 0.658616
Epoch 960
Validation auc = 0.663741
Epoch 961
Validation auc = 0.666685
Epoch 962
Loss = 4.5669e-02, PNorm = 117.5814, GNorm = 1.0966, lr_0 = 9.5228e-04
Validation auc = 0.670937
Epoch 963
Validation auc = 0.673118
Epoch 964
Validation auc = 0.675189
Epoch 965
Validation auc = 0.676389
Epoch 966
Loss = 3.1224e-03, PNorm = 117.6327, GNorm = 0.0811, lr_0 = 9.5204e-04
Validation auc = 0.675953
Epoch 967
Validation auc = 0.675953
Epoch 968
Validation auc = 0.675844
Epoch 969
Validation auc = 0.675680
Epoch 970
Validation auc = 0.678788
Epoch 971
Loss = 1.9338e-03, PNorm = 117.6717, GNorm = 0.0689, lr_0 = 9.5180e-04
Loss = 6.0699e-04, PNorm = 117.6740, GNorm = 0.0248, lr_0 = 9.5179e-04
Validation auc = 0.680314
Epoch 972
Validation auc = 0.680423
Epoch 973
Validation auc = 0.668157
Epoch 974
Validation auc = 0.652620
Epoch 975
Validation auc = 0.639645
Epoch 976
Loss = 2.5786e-03, PNorm = 117.7012, GNorm = 0.0926, lr_0 = 9.5157e-04
Validation auc = 0.629668
Epoch 977
Validation auc = 0.626942
Epoch 978
Validation auc = 0.629395
Epoch 979
Validation auc = 0.631085
Epoch 980
Validation auc = 0.634247
Epoch 981
Loss = 5.6296e-04, PNorm = 117.7369, GNorm = 0.0104, lr_0 = 9.5132e-04
Validation auc = 0.635774
Epoch 982
Validation auc = 0.638391
Epoch 983
Validation auc = 0.638936
Epoch 984
Validation auc = 0.642534
Epoch 985
Loss = 4.6701e-03, PNorm = 117.7959, GNorm = 0.2086, lr_0 = 9.5110e-04
Loss = 3.8837e-04, PNorm = 117.7998, GNorm = 0.0120, lr_0 = 9.5108e-04
Validation auc = 0.647059
Epoch 986
Validation auc = 0.650657
Epoch 987
Validation auc = 0.653056
Epoch 988
Validation auc = 0.655073
Epoch 989
Validation auc = 0.655836
Epoch 990
Loss = 4.1178e-04, PNorm = 117.8404, GNorm = 0.0074, lr_0 = 9.5084e-04
Loss = 1.3606e-04, PNorm = 117.8422, GNorm = 0.0042, lr_0 = 9.5083e-04
Validation auc = 0.655727
Epoch 991
Validation auc = 0.655891
Epoch 992
Validation auc = 0.655836
Epoch 993
Validation auc = 0.655945
Epoch 994
Validation auc = 0.656490
Epoch 995
Loss = 5.1886e-04, PNorm = 117.8584, GNorm = 0.0109, lr_0 = 9.5061e-04
Validation auc = 0.656000
Epoch 996
Validation auc = 0.656000
Epoch 997
Validation auc = 0.653437
Epoch 998
Validation auc = 0.648422
Epoch 999
Loss = 3.3080e-03, PNorm = 117.8959, GNorm = 0.0132, lr_0 = 9.5037e-04
Validation auc = 0.645042
Epoch 1000
Validation auc = 0.640953
Epoch 1001
Validation auc = 0.637464
Epoch 1002
Validation auc = 0.635338
Epoch 1003
Validation auc = 0.634847
Epoch 1004
Loss = 4.1869e-04, PNorm = 117.9437, GNorm = 0.0070, lr_0 = 9.5014e-04
Loss = 3.4709e-04, PNorm = 117.9462, GNorm = 0.0101, lr_0 = 9.5012e-04
Validation auc = 0.632775
Epoch 1005
Validation auc = 0.632666
Epoch 1006
Validation auc = 0.632230
Epoch 1007
Validation auc = 0.631903
Epoch 1008
Validation auc = 0.635065
Epoch 1009
Loss = 9.3264e-04, PNorm = 117.9657, GNorm = 0.0520, lr_0 = 9.4990e-04
Validation auc = 0.638282
Epoch 1010
Validation auc = 0.639536
Epoch 1011
Validation auc = 0.639863
Epoch 1012
Validation auc = 0.639099
Epoch 1013
Validation auc = 0.638772
Epoch 1014
Loss = 4.8393e-04, PNorm = 117.9866, GNorm = 0.0128, lr_0 = 9.4965e-04
Validation auc = 0.638718
Epoch 1015
Validation auc = 0.639426
Epoch 1016
Validation auc = 0.640571
Epoch 1017
Validation auc = 0.641389
Epoch 1018
Loss = 3.6353e-04, PNorm = 118.0007, GNorm = 0.0175, lr_0 = 9.4943e-04
Loss = 1.1902e-04, PNorm = 118.0017, GNorm = 0.0036, lr_0 = 9.4941e-04
Validation auc = 0.642370
Epoch 1019
Validation auc = 0.643079
Epoch 1020
Validation auc = 0.642643
Epoch 1021
Validation auc = 0.642970
Epoch 1022
Validation auc = 0.643297
Epoch 1023
Loss = 1.2021e-04, PNorm = 118.0126, GNorm = 0.0032, lr_0 = 9.4918e-04
Loss = 6.6897e-04, PNorm = 118.0135, GNorm = 0.0225, lr_0 = 9.4916e-04
Validation auc = 0.644169
Epoch 1024
Validation auc = 0.644497
Epoch 1025
Validation auc = 0.644606
Epoch 1026
Validation auc = 0.644497
Epoch 1027
Validation auc = 0.644987
Epoch 1028
Loss = 1.1337e-04, PNorm = 118.0225, GNorm = 0.0026, lr_0 = 9.4894e-04
Validation auc = 0.645478
Epoch 1029
Validation auc = 0.645968
Epoch 1030
Validation auc = 0.647440
Epoch 1031
Validation auc = 0.648313
Epoch 1032
Validation auc = 0.647931
Epoch 1033
Loss = 4.8464e-04, PNorm = 118.0333, GNorm = 0.0092, lr_0 = 9.4869e-04
Validation auc = 0.647277
Epoch 1034
Validation auc = 0.646950
Epoch 1035
Validation auc = 0.646568
Epoch 1036
Validation auc = 0.646132
Epoch 1037
Loss = 5.5253e-04, PNorm = 118.0444, GNorm = 0.0065, lr_0 = 9.4847e-04
Loss = 6.3831e-05, PNorm = 118.0452, GNorm = 0.0029, lr_0 = 9.4845e-04
Validation auc = 0.646078
Epoch 1038
Validation auc = 0.646078
Epoch 1039
Validation auc = 0.645859
Epoch 1040
Validation auc = 0.645696
Epoch 1041
Validation auc = 0.645805
Epoch 1042
Loss = 1.9263e-04, PNorm = 118.0540, GNorm = 0.0037, lr_0 = 9.4823e-04
Validation auc = 0.645914
Epoch 1043
Validation auc = 0.646459
Epoch 1044
Validation auc = 0.648095
Epoch 1045
Validation auc = 0.648422
Epoch 1046
Validation auc = 0.649567
Epoch 1047
Loss = 4.2084e-04, PNorm = 118.0645, GNorm = 0.0087, lr_0 = 9.4798e-04
Validation auc = 0.649785
Epoch 1048
Validation auc = 0.649021
Epoch 1049
Validation auc = 0.648585
Epoch 1050
Validation auc = 0.648367
Epoch 1051
Loss = 4.2308e-04, PNorm = 118.0818, GNorm = 0.0085, lr_0 = 9.4776e-04
Loss = 2.8585e-04, PNorm = 118.0831, GNorm = 0.0094, lr_0 = 9.4775e-04
Validation auc = 0.647986
Epoch 1052
Validation auc = 0.647331
Epoch 1053
Validation auc = 0.647440
Epoch 1054
Validation auc = 0.647059
Epoch 1055
Validation auc = 0.647168
Epoch 1056
Loss = 2.1293e-04, PNorm = 118.0965, GNorm = 0.0027, lr_0 = 9.4751e-04
Loss = 6.2277e-05, PNorm = 118.0972, GNorm = 0.0029, lr_0 = 9.4749e-04
Validation auc = 0.647059
Epoch 1057
Validation auc = 0.647277
Epoch 1058
Validation auc = 0.647331
Epoch 1059
Validation auc = 0.647059
Epoch 1060
Validation auc = 0.647113
Epoch 1061
Loss = 1.1071e-04, PNorm = 118.1045, GNorm = 0.0021, lr_0 = 9.4728e-04
Validation auc = 0.647386
Epoch 1062
Validation auc = 0.647222
Epoch 1063
Validation auc = 0.647168
Epoch 1064
Validation auc = 0.647386
Epoch 1065
Validation auc = 0.647440
Epoch 1066
Loss = 1.6008e-04, PNorm = 118.1114, GNorm = 0.0086, lr_0 = 9.4702e-04
Validation auc = 0.647549
Epoch 1067
Validation auc = 0.647386
Epoch 1068
Validation auc = 0.647549
Epoch 1069
Validation auc = 0.647440
Epoch 1070
Loss = 4.0127e-04, PNorm = 118.1157, GNorm = 0.0012, lr_0 = 9.4681e-04
Loss = 7.2610e-05, PNorm = 118.1160, GNorm = 0.0023, lr_0 = 9.4679e-04
Validation auc = 0.647713
Epoch 1071
Validation auc = 0.647549
Epoch 1072
Validation auc = 0.647822
Epoch 1073
Validation auc = 0.647604
Epoch 1074
Validation auc = 0.647495
Epoch 1075
Loss = 1.5544e-04, PNorm = 118.1200, GNorm = 0.0058, lr_0 = 9.4657e-04
Validation auc = 0.647549
Epoch 1076
Validation auc = 0.647440
Epoch 1077
Validation auc = 0.647331
Epoch 1078
Validation auc = 0.647331
Epoch 1079
Validation auc = 0.647440
Epoch 1080
Loss = 4.4043e-05, PNorm = 118.1236, GNorm = 0.0009, lr_0 = 9.4632e-04
Validation auc = 0.647495
Epoch 1081
Validation auc = 0.647386
Epoch 1082
Validation auc = 0.647331
Epoch 1083
Validation auc = 0.647277
Epoch 1084
Loss = 2.3853e-04, PNorm = 118.1265, GNorm = 0.0197, lr_0 = 9.4610e-04
Loss = 5.6996e-05, PNorm = 118.1267, GNorm = 0.0026, lr_0 = 9.4608e-04
Validation auc = 0.647168
Epoch 1085
Validation auc = 0.647386
Epoch 1086
Validation auc = 0.647713
Epoch 1087
Validation auc = 0.648640
Epoch 1088
Validation auc = 0.649730
Epoch 1089
Loss = 9.9897e-05, PNorm = 118.1304, GNorm = 0.0034, lr_0 = 9.4585e-04
Loss = 9.6944e-05, PNorm = 118.1308, GNorm = 0.0026, lr_0 = 9.4583e-04
Validation auc = 0.650657
Epoch 1090
Validation auc = 0.651039
Epoch 1091
Validation auc = 0.651039
Epoch 1092
Validation auc = 0.651039
Epoch 1093
Validation auc = 0.651202
Epoch 1094
Loss = 8.7955e-05, PNorm = 118.1349, GNorm = 0.0018, lr_0 = 9.4561e-04
Validation auc = 0.651366
Epoch 1095
Validation auc = 0.651475
Epoch 1096
Validation auc = 0.651638
Epoch 1097
Validation auc = 0.651638
Epoch 1098
Validation auc = 0.651529
Epoch 1099
Loss = 3.5614e-05, PNorm = 118.1390, GNorm = 0.0009, lr_0 = 9.4536e-04
Validation auc = 0.651584
Epoch 1100
Validation auc = 0.651747
Epoch 1101
Validation auc = 0.651856
Epoch 1102
Validation auc = 0.651911
Epoch 1103
Loss = 6.0159e-05, PNorm = 118.1418, GNorm = 0.0011, lr_0 = 9.4515e-04
Loss = 2.9494e-04, PNorm = 118.1420, GNorm = 0.0160, lr_0 = 9.4513e-04
Validation auc = 0.652020
Epoch 1104
Validation auc = 0.652183
Epoch 1105
Validation auc = 0.652183
Epoch 1106
Validation auc = 0.652020
Epoch 1107
Validation auc = 0.651802
Epoch 1108
Loss = 6.4347e-05, PNorm = 118.1455, GNorm = 0.0015, lr_0 = 9.4489e-04
Validation auc = 0.651911
Epoch 1109
Validation auc = 0.652020
Epoch 1110
Validation auc = 0.652020
Epoch 1111
Validation auc = 0.652074
Epoch 1112
Validation auc = 0.652020
Epoch 1113
Loss = 5.6551e-05, PNorm = 118.1484, GNorm = 0.0012, lr_0 = 9.4466e-04
Validation auc = 0.652020
Epoch 1114
Validation auc = 0.652020
Epoch 1115
Validation auc = 0.652020
Epoch 1116
Validation auc = 0.651584
Epoch 1117
Loss = 6.3665e-05, PNorm = 118.1503, GNorm = 0.0009, lr_0 = 9.4444e-04
Loss = 4.1660e-05, PNorm = 118.1504, GNorm = 0.0013, lr_0 = 9.4443e-04
Validation auc = 0.651529
Epoch 1118
Validation auc = 0.651311
Epoch 1119
Validation auc = 0.650930
Epoch 1120
Validation auc = 0.650820
Epoch 1121
Validation auc = 0.650766
Epoch 1122
Loss = 9.6689e-05, PNorm = 118.1523, GNorm = 0.0071, lr_0 = 9.4419e-04
Loss = 4.4504e-06, PNorm = 118.1524, GNorm = 0.0003, lr_0 = 9.4417e-04
Validation auc = 0.650930
Epoch 1123
Validation auc = 0.650384
Epoch 1124
Validation auc = 0.650003
Epoch 1125
Validation auc = 0.650057
Epoch 1126
Validation auc = 0.650112
Epoch 1127
Loss = 5.5587e-05, PNorm = 118.1538, GNorm = 0.0011, lr_0 = 9.4396e-04
Validation auc = 0.650330
Epoch 1128
Validation auc = 0.650112
Epoch 1129
Validation auc = 0.650112
Epoch 1130
Validation auc = 0.650112
Epoch 1131
Validation auc = 0.650166
Epoch 1132
Loss = 3.9565e-05, PNorm = 118.1555, GNorm = 0.0008, lr_0 = 9.4371e-04
Validation auc = 0.649948
Epoch 1133
Validation auc = 0.650003
Epoch 1134
Validation auc = 0.650003
Epoch 1135
Validation auc = 0.649894
Epoch 1136
Loss = 4.1984e-05, PNorm = 118.1570, GNorm = 0.0010, lr_0 = 9.4349e-04
Loss = 5.6262e-05, PNorm = 118.1571, GNorm = 0.0022, lr_0 = 9.4347e-04
Validation auc = 0.650003
Epoch 1137
Validation auc = 0.650003
Epoch 1138
Validation auc = 0.651693
Epoch 1139
Validation auc = 0.651802
Epoch 1140
Validation auc = 0.651148
Epoch 1141
Loss = 5.6344e-05, PNorm = 118.1578, GNorm = 0.0014, lr_0 = 9.4324e-04
Validation auc = 0.650548
Epoch 1142
Validation auc = 0.650602
Epoch 1143
Validation auc = 0.649730
Epoch 1144
Validation auc = 0.649458
Epoch 1145
Validation auc = 0.649239
Epoch 1146
Loss = 1.5151e-04, PNorm = 118.1627, GNorm = 0.0055, lr_0 = 9.4300e-04
Validation auc = 0.649349
Epoch 1147
Validation auc = 0.649185
Epoch 1148
Validation auc = 0.648967
Epoch 1149
Validation auc = 0.648967
Epoch 1150
Loss = 1.2163e-03, PNorm = 118.1672, GNorm = 0.1371, lr_0 = 9.4279e-04
Loss = 5.3303e-05, PNorm = 118.1674, GNorm = 0.0022, lr_0 = 9.4277e-04
Validation auc = 0.648912
Epoch 1151
Validation auc = 0.649239
Epoch 1152
Validation auc = 0.648912
Epoch 1153
Validation auc = 0.648967
Epoch 1154
Validation auc = 0.649185
Epoch 1155
Loss = 1.1607e-04, PNorm = 118.1720, GNorm = 0.0044, lr_0 = 9.4253e-04
Loss = 2.1259e-06, PNorm = 118.1723, GNorm = 0.0002, lr_0 = 9.4252e-04
Validation auc = 0.649185
Epoch 1156
Validation auc = 0.649676
Epoch 1157
Validation auc = 0.649730
Epoch 1158
Validation auc = 0.649785
Epoch 1159
Validation auc = 0.649676
Epoch 1160
Loss = 9.0438e-05, PNorm = 118.1762, GNorm = 0.0030, lr_0 = 9.4230e-04
Validation auc = 0.649730
Epoch 1161
Validation auc = 0.649512
Epoch 1162
Validation auc = 0.649458
Epoch 1163
Validation auc = 0.649458
Epoch 1164
Validation auc = 0.649294
Epoch 1165
Loss = 2.6048e-05, PNorm = 118.1808, GNorm = 0.0005, lr_0 = 9.4205e-04
Validation auc = 0.648967
Epoch 1166
Validation auc = 0.648749
Epoch 1167
Validation auc = 0.648749
Epoch 1168
Validation auc = 0.649239
Epoch 1169
Loss = 8.8943e-05, PNorm = 118.1829, GNorm = 0.0015, lr_0 = 9.4183e-04
Loss = 6.3176e-05, PNorm = 118.1838, GNorm = 0.0018, lr_0 = 9.4182e-04
Validation auc = 0.650493
Epoch 1170
Validation auc = 0.650493
Epoch 1171
Validation auc = 0.652838
Epoch 1172
Validation auc = 0.655291
Epoch 1173
Validation auc = 0.657690
Epoch 1174
Loss = 1.1252e-04, PNorm = 118.2041, GNorm = 0.0034, lr_0 = 9.4158e-04
Validation auc = 0.658998
Epoch 1175
Validation auc = 0.660197
Epoch 1176
Validation auc = 0.660852
Epoch 1177
Validation auc = 0.661397
Epoch 1178
Validation auc = 0.661615
Epoch 1179
Loss = 4.9753e-05, PNorm = 118.2153, GNorm = 0.0014, lr_0 = 9.4135e-04
Validation auc = 0.661778
Epoch 1180
Validation auc = 0.662051
Epoch 1181
Validation auc = 0.662269
Epoch 1182
Validation auc = 0.662378
Epoch 1183
Loss = 1.3626e-04, PNorm = 118.2203, GNorm = 0.0033, lr_0 = 9.4112e-04
Validation auc = 0.662596
Epoch 1184
Validation auc = 0.663087
Epoch 1185
Validation auc = 0.663196
Epoch 1186
Validation auc = 0.663305
Epoch 1187
Validation auc = 0.663250
Epoch 1188
Loss = 1.0401e-04, PNorm = 118.2231, GNorm = 0.0080, lr_0 = 9.4088e-04
Loss = 1.4781e-04, PNorm = 118.2232, GNorm = 0.0108, lr_0 = 9.4087e-04
Validation auc = 0.663196
Epoch 1189
Validation auc = 0.663087
Epoch 1190
Validation auc = 0.662869
Epoch 1191
Validation auc = 0.662760
Epoch 1192
Validation auc = 0.662542
Epoch 1193
Loss = 3.1641e-05, PNorm = 118.2252, GNorm = 0.0006, lr_0 = 9.4065e-04
Validation auc = 0.662433
Epoch 1194
Validation auc = 0.662105
Epoch 1195
Validation auc = 0.662160
Epoch 1196
Validation auc = 0.662269
Epoch 1197
Validation auc = 0.661560
Epoch 1198
Loss = 8.3997e-05, PNorm = 118.2267, GNorm = 0.0020, lr_0 = 9.4040e-04
Validation auc = 0.661397
Epoch 1199
Validation auc = 0.660852
Epoch 1200
Validation auc = 0.660579
Epoch 1201
Validation auc = 0.660797
Epoch 1202
Loss = 7.2419e-05, PNorm = 118.2283, GNorm = 0.0018, lr_0 = 9.4018e-04
Loss = 4.0824e-05, PNorm = 118.2285, GNorm = 0.0021, lr_0 = 9.4016e-04
Validation auc = 0.661070
Epoch 1203
Validation auc = 0.661288
Epoch 1204
Validation auc = 0.661397
Epoch 1205
Validation auc = 0.661397
Epoch 1206
Validation auc = 0.661179
Epoch 1207
Loss = 5.3901e-05, PNorm = 118.2317, GNorm = 0.0008, lr_0 = 9.3993e-04
Loss = 2.8902e-04, PNorm = 118.2319, GNorm = 0.0074, lr_0 = 9.3991e-04
Validation auc = 0.661179
Epoch 1208
Validation auc = 0.661179
Epoch 1209
Validation auc = 0.661342
Epoch 1210
Validation auc = 0.661506
Epoch 1211
Validation auc = 0.661615
Epoch 1212
Loss = 1.0182e-04, PNorm = 118.2348, GNorm = 0.0022, lr_0 = 9.3970e-04
Validation auc = 0.661560
Epoch 1213
Validation auc = 0.661451
Epoch 1214
Validation auc = 0.661451
Epoch 1215
Validation auc = 0.661451
Epoch 1216
Loss = 4.6322e-05, PNorm = 118.2376, GNorm = 0.0004, lr_0 = 9.3946e-04
Validation auc = 0.661669
Epoch 1217
Validation auc = 0.661724
Epoch 1218
Validation auc = 0.661778
Epoch 1219
Validation auc = 0.661942
Epoch 1220
Validation auc = 0.661833
Epoch 1221
Loss = 3.4778e-05, PNorm = 118.2399, GNorm = 0.0010, lr_0 = 9.3923e-04
Loss = 1.9430e-05, PNorm = 118.2400, GNorm = 0.0008, lr_0 = 9.3922e-04
Validation auc = 0.661724
Epoch 1222
Validation auc = 0.661778
Epoch 1223
Validation auc = 0.661724
Epoch 1224
Validation auc = 0.661615
Epoch 1225
Validation auc = 0.661615
Epoch 1226
Loss = 2.1392e-05, PNorm = 118.2423, GNorm = 0.0005, lr_0 = 9.3900e-04
Validation auc = 0.661560
Epoch 1227
Validation auc = 0.661451
Epoch 1228
Validation auc = 0.661342
Epoch 1229
Validation auc = 0.661288
Epoch 1230
Validation auc = 0.661288
Epoch 1231
Loss = 3.0882e-05, PNorm = 118.2450, GNorm = 0.0008, lr_0 = 9.3875e-04
Validation auc = 0.661397
Epoch 1232
Validation auc = 0.661342
Epoch 1233
Validation auc = 0.661506
Epoch 1234
Validation auc = 0.661560
Epoch 1235
Loss = 4.2091e-05, PNorm = 118.2471, GNorm = 0.0007, lr_0 = 9.3853e-04
Loss = 1.3709e-06, PNorm = 118.2472, GNorm = 0.0001, lr_0 = 9.3852e-04
Validation auc = 0.661342
Epoch 1236
Validation auc = 0.661342
Epoch 1237
Validation auc = 0.661506
Epoch 1238
Validation auc = 0.661451
Epoch 1239
Validation auc = 0.661233
Epoch 1240
Loss = 3.3105e-05, PNorm = 118.2488, GNorm = 0.0010, lr_0 = 9.3828e-04
Loss = 1.3192e-05, PNorm = 118.2489, GNorm = 0.0004, lr_0 = 9.3827e-04
Validation auc = 0.661124
Epoch 1241
Validation auc = 0.661233
Epoch 1242
Validation auc = 0.661397
Epoch 1243
Validation auc = 0.661451
Epoch 1244
Validation auc = 0.661669
Epoch 1245
Loss = 1.4233e-04, PNorm = 118.2508, GNorm = 0.0036, lr_0 = 9.3805e-04
Validation auc = 0.662051
Epoch 1246
Validation auc = 0.662160
Epoch 1247
Validation auc = 0.662433
Epoch 1248
Validation auc = 0.662487
Epoch 1249
Loss = 2.5909e-05, PNorm = 118.2527, GNorm = 0.0002, lr_0 = 9.3782e-04
Validation auc = 0.662433
Epoch 1250
Validation auc = 0.662214
Epoch 1251
Validation auc = 0.662160
Epoch 1252
Validation auc = 0.662051
Epoch 1253
Validation auc = 0.662105
Epoch 1254
Loss = 2.1247e-05, PNorm = 118.2548, GNorm = 0.0006, lr_0 = 9.3758e-04
Loss = 2.5232e-05, PNorm = 118.2549, GNorm = 0.0007, lr_0 = 9.3757e-04
Validation auc = 0.661996
Epoch 1255
Validation auc = 0.662051
Epoch 1256
Validation auc = 0.662105
Epoch 1257
Validation auc = 0.662105
Epoch 1258
Validation auc = 0.661996
Epoch 1259
Loss = 1.7578e-05, PNorm = 118.2563, GNorm = 0.0005, lr_0 = 9.3735e-04
Validation auc = 0.661942
Epoch 1260
Validation auc = 0.661996
Epoch 1261
Validation auc = 0.662105
Epoch 1262
Validation auc = 0.662105
Epoch 1263
Validation auc = 0.662105
Epoch 1264
Loss = 4.0362e-05, PNorm = 118.2577, GNorm = 0.0010, lr_0 = 9.3710e-04
Validation auc = 0.662051
Epoch 1265
Validation auc = 0.661996
Epoch 1266
Validation auc = 0.661996
Epoch 1267
Validation auc = 0.661833
Epoch 1268
Loss = 8.1081e-05, PNorm = 118.2587, GNorm = 0.0003, lr_0 = 9.3689e-04
Loss = 1.8080e-06, PNorm = 118.2588, GNorm = 0.0001, lr_0 = 9.3687e-04
Validation auc = 0.661615
Epoch 1269
Validation auc = 0.661506
Epoch 1270
Validation auc = 0.661506
Epoch 1271
Validation auc = 0.661560
Epoch 1272
Validation auc = 0.661615
Epoch 1273
Loss = 5.2960e-05, PNorm = 118.2602, GNorm = 0.0003, lr_0 = 9.3664e-04
Loss = 1.1066e-05, PNorm = 118.2603, GNorm = 0.0004, lr_0 = 9.3662e-04
Validation auc = 0.661506
Epoch 1274
Validation auc = 0.661506
Epoch 1275
Validation auc = 0.661560
Epoch 1276
Validation auc = 0.661669
Epoch 1277
Validation auc = 0.661669
Epoch 1278
Loss = 3.0594e-05, PNorm = 118.2615, GNorm = 0.0013, lr_0 = 9.3641e-04
Validation auc = 0.661887
Epoch 1279
Validation auc = 0.661288
Epoch 1280
Validation auc = 0.661288
Epoch 1281
Validation auc = 0.661288
Epoch 1282
Validation auc = 0.661451
Epoch 1283
Loss = 1.5938e-05, PNorm = 118.2653, GNorm = 0.0004, lr_0 = 9.3616e-04
Validation auc = 0.661451
Epoch 1284
Validation auc = 0.661560
Epoch 1285
Validation auc = 0.661669
Epoch 1286
Validation auc = 0.661506
Epoch 1287
Loss = 2.8102e-05, PNorm = 118.2673, GNorm = 0.0005, lr_0 = 9.3594e-04
Loss = 9.7750e-06, PNorm = 118.2674, GNorm = 0.0004, lr_0 = 9.3592e-04
Validation auc = 0.661615
Epoch 1288
Validation auc = 0.661560
Epoch 1289
Validation auc = 0.661615
Epoch 1290
Validation auc = 0.661615
Epoch 1291
Validation auc = 0.661560
Epoch 1292
Loss = 1.6617e-05, PNorm = 118.2690, GNorm = 0.0005, lr_0 = 9.3571e-04
Validation auc = 0.661615
Epoch 1293
Validation auc = 0.661778
Epoch 1294
Validation auc = 0.661778
Epoch 1295
Validation auc = 0.661887
Epoch 1296
Validation auc = 0.661833
Epoch 1297
Loss = 2.0703e-05, PNorm = 118.2709, GNorm = 0.0005, lr_0 = 9.3546e-04
Validation auc = 0.661778
Epoch 1298
Validation auc = 0.661724
Epoch 1299
Validation auc = 0.661778
Epoch 1300
Validation auc = 0.661615
Epoch 1301
Loss = 1.8956e-05, PNorm = 118.2726, GNorm = 0.0005, lr_0 = 9.3524e-04
Loss = 1.8774e-05, PNorm = 118.2727, GNorm = 0.0011, lr_0 = 9.3523e-04
Validation auc = 0.661397
Epoch 1302
Validation auc = 0.661560
Epoch 1303
Validation auc = 0.661615
Epoch 1304
Validation auc = 0.661560
Epoch 1305
Validation auc = 0.661560
Epoch 1306
Loss = 1.5915e-05, PNorm = 118.2743, GNorm = 0.0003, lr_0 = 9.3499e-04
Loss = 6.7750e-06, PNorm = 118.2744, GNorm = 0.0002, lr_0 = 9.3498e-04
Validation auc = 0.661615
Epoch 1307
Validation auc = 0.661724
Epoch 1308
Validation auc = 0.661560
Epoch 1309
Validation auc = 0.661615
Epoch 1310
Validation auc = 0.661506
Epoch 1311
Loss = 2.1287e-05, PNorm = 118.2757, GNorm = 0.0006, lr_0 = 9.3476e-04
Validation auc = 0.661506
Epoch 1312
Validation auc = 0.661560
Epoch 1313
Validation auc = 0.661560
Epoch 1314
Validation auc = 0.661451
Epoch 1315
Validation auc = 0.661451
Epoch 1316
Loss = 1.5841e-05, PNorm = 118.2770, GNorm = 0.0007, lr_0 = 9.3451e-04
Validation auc = 0.661397
Epoch 1317
Validation auc = 0.662487
Epoch 1318
Validation auc = 0.662923
Epoch 1319
Validation auc = 0.663196
Epoch 1320
Loss = 4.9848e-05, PNorm = 118.2817, GNorm = 0.0018, lr_0 = 9.3430e-04
Loss = 1.7108e-04, PNorm = 118.2821, GNorm = 0.0050, lr_0 = 9.3428e-04
Validation auc = 0.663087
Epoch 1321
Validation auc = 0.662814
Epoch 1322
Validation auc = 0.662814
Epoch 1323
Validation auc = 0.662487
Epoch 1324
Validation auc = 0.662105
Epoch 1325
Loss = 2.1220e-04, PNorm = 118.2866, GNorm = 0.0138, lr_0 = 9.3407e-04
Validation auc = 0.662105
Epoch 1326
Validation auc = 0.662051
Epoch 1327
Validation auc = 0.662051
Epoch 1328
Validation auc = 0.661669
Epoch 1329
Validation auc = 0.661288
Epoch 1330
Loss = 3.4888e-05, PNorm = 118.2910, GNorm = 0.0014, lr_0 = 9.3382e-04
Validation auc = 0.661179
Epoch 1331
Validation auc = 0.661179
Epoch 1332
Validation auc = 0.661070
Epoch 1333
Validation auc = 0.661233
Epoch 1334
Loss = 3.2101e-05, PNorm = 118.2934, GNorm = 0.0011, lr_0 = 9.3360e-04
Loss = 4.3906e-05, PNorm = 118.2936, GNorm = 0.0028, lr_0 = 9.3359e-04
Validation auc = 0.661124
Epoch 1335
Validation auc = 0.661015
Epoch 1336
Validation auc = 0.661015
Epoch 1337
Validation auc = 0.661070
Epoch 1338
Validation auc = 0.660961
Epoch 1339
Loss = 2.1798e-05, PNorm = 118.2957, GNorm = 0.0005, lr_0 = 9.3336e-04
Loss = 6.1194e-06, PNorm = 118.2959, GNorm = 0.0004, lr_0 = 9.3334e-04
Validation auc = 0.660961
Epoch 1340
Validation auc = 0.661015
Epoch 1341
Validation auc = 0.660961
Epoch 1342
Validation auc = 0.660906
Epoch 1343
Validation auc = 0.660961
Epoch 1344
Loss = 1.8846e-05, PNorm = 118.2973, GNorm = 0.0005, lr_0 = 9.3312e-04
Validation auc = 0.660906
Epoch 1345
Validation auc = 0.661015
Epoch 1346
Validation auc = 0.661015
Epoch 1347
Validation auc = 0.661015
Epoch 1348
Validation auc = 0.661015
Epoch 1349
Loss = 1.6120e-05, PNorm = 118.2988, GNorm = 0.0005, lr_0 = 9.3288e-04
Validation auc = 0.661124
Epoch 1350
Validation auc = 0.661070
Epoch 1351
Validation auc = 0.661015
Epoch 1352
Validation auc = 0.661070
Epoch 1353
Loss = 1.4514e-05, PNorm = 118.3001, GNorm = 0.0002, lr_0 = 9.3266e-04
Loss = 3.4111e-05, PNorm = 118.3002, GNorm = 0.0019, lr_0 = 9.3264e-04
Validation auc = 0.660852
Epoch 1354
Validation auc = 0.660688
Epoch 1355
Validation auc = 0.660579
Epoch 1356
Validation auc = 0.660524
Epoch 1357
Validation auc = 0.660633
Epoch 1358
Loss = 1.4233e-05, PNorm = 118.3014, GNorm = 0.0004, lr_0 = 9.3241e-04
Validation auc = 0.660579
Epoch 1359
Validation auc = 0.660743
Epoch 1360
Validation auc = 0.660852
Epoch 1361
Validation auc = 0.661070
Epoch 1362
Validation auc = 0.661070
Epoch 1363
Loss = 2.4026e-05, PNorm = 118.3025, GNorm = 0.0008, lr_0 = 9.3218e-04
Validation auc = 0.661015
Epoch 1364
Validation auc = 0.660906
Epoch 1365
Validation auc = 0.660906
Epoch 1366
Validation auc = 0.660852
Epoch 1367
Loss = 9.2657e-06, PNorm = 118.3034, GNorm = 0.0002, lr_0 = 9.3197e-04
Loss = 1.7622e-05, PNorm = 118.3034, GNorm = 0.0010, lr_0 = 9.3195e-04
Validation auc = 0.660797
Epoch 1368
Validation auc = 0.660797
Epoch 1369
Validation auc = 0.660852
Epoch 1370
Validation auc = 0.660852
Epoch 1371
Validation auc = 0.660906
Epoch 1372
Loss = 1.2859e-05, PNorm = 118.3046, GNorm = 0.0005, lr_0 = 9.3172e-04
Loss = 2.3026e-05, PNorm = 118.3046, GNorm = 0.0015, lr_0 = 9.3170e-04
Validation auc = 0.660906
Epoch 1373
Validation auc = 0.660852
Epoch 1374
Validation auc = 0.660852
Epoch 1375
Validation auc = 0.660797
Epoch 1376
Validation auc = 0.660688
Epoch 1377
Loss = 1.2681e-05, PNorm = 118.3056, GNorm = 0.0003, lr_0 = 9.3149e-04
Validation auc = 0.660797
Epoch 1378
Validation auc = 0.660743
Epoch 1379
Validation auc = 0.660688
Epoch 1380
Validation auc = 0.660688
Epoch 1381
Validation auc = 0.660688
Epoch 1382
Loss = 3.7240e-06, PNorm = 118.3065, GNorm = 0.0001, lr_0 = 9.3124e-04
Validation auc = 0.660743
Epoch 1383
Validation auc = 0.660579
Epoch 1384
Validation auc = 0.660524
Epoch 1385
Validation auc = 0.660415
Epoch 1386
Loss = 1.0905e-05, PNorm = 118.3064, GNorm = 0.0003, lr_0 = 9.3102e-04
Loss = 1.0371e-05, PNorm = 118.3064, GNorm = 0.0008, lr_0 = 9.3101e-04
Validation auc = 0.660524
Epoch 1387
Validation auc = 0.660415
Epoch 1388
Validation auc = 0.660470
Epoch 1389
Validation auc = 0.660470
Epoch 1390
Validation auc = 0.660470
Epoch 1391
Loss = 1.3823e-05, PNorm = 118.3070, GNorm = 0.0009, lr_0 = 9.3078e-04
Validation auc = 0.660470
Epoch 1392
Validation auc = 0.660524
Epoch 1393
Validation auc = 0.660579
Epoch 1394
Validation auc = 0.660579
Epoch 1395
Validation auc = 0.660579
Epoch 1396
Loss = 1.0473e-05, PNorm = 118.3077, GNorm = 0.0003, lr_0 = 9.3055e-04
Validation auc = 0.660579
Epoch 1397
Validation auc = 0.660633
Epoch 1398
Validation auc = 0.660579
Epoch 1399
Validation auc = 0.660852
Epoch 1400
Loss = 8.1583e-06, PNorm = 118.3081, GNorm = 0.0001, lr_0 = 9.3033e-04
Loss = 7.2717e-06, PNorm = 118.3082, GNorm = 0.0002, lr_0 = 9.3032e-04
Validation auc = 0.661124
Epoch 1401
Validation auc = 0.661070
Epoch 1402
Validation auc = 0.661124
Epoch 1403
Validation auc = 0.661124
Epoch 1404
Validation auc = 0.661179
Epoch 1405
Loss = 1.1641e-05, PNorm = 118.3089, GNorm = 0.0005, lr_0 = 9.3008e-04
Loss = 4.8478e-06, PNorm = 118.3090, GNorm = 0.0002, lr_0 = 9.3007e-04
Validation auc = 0.661288
Epoch 1406
Validation auc = 0.661342
Epoch 1407
Validation auc = 0.661506
Epoch 1408
Validation auc = 0.661451
Epoch 1409
Validation auc = 0.661451
Epoch 1410
Loss = 8.7734e-06, PNorm = 118.3101, GNorm = 0.0002, lr_0 = 9.2985e-04
Validation auc = 0.660961
Epoch 1411
Validation auc = 0.660579
Epoch 1412
Validation auc = 0.660306
Epoch 1413
Validation auc = 0.660088
Epoch 1414
Validation auc = 0.659816
Epoch 1415
Loss = 2.5080e-05, PNorm = 118.3118, GNorm = 0.0006, lr_0 = 9.2961e-04
Validation auc = 0.659925
Epoch 1416
Validation auc = 0.659925
Epoch 1417
Validation auc = 0.659761
Epoch 1418
Validation auc = 0.659761
Epoch 1419
Loss = 2.4884e-05, PNorm = 118.3135, GNorm = 0.0006, lr_0 = 9.2939e-04
Loss = 2.8926e-05, PNorm = 118.3137, GNorm = 0.0008, lr_0 = 9.2938e-04
Validation auc = 0.659652
Epoch 1420
Validation auc = 0.659707
Epoch 1421
Validation auc = 0.659707
Epoch 1422
Validation auc = 0.659707
Epoch 1423
Validation auc = 0.659652
Epoch 1424
Loss = 1.1616e-05, PNorm = 118.3155, GNorm = 0.0003, lr_0 = 9.2914e-04
Validation auc = 0.659598
Epoch 1425
Validation auc = 0.659543
Epoch 1426
Validation auc = 0.659598
Epoch 1427
Validation auc = 0.659598
Epoch 1428
Validation auc = 0.659271
Epoch 1429
Loss = 6.4229e-06, PNorm = 118.3168, GNorm = 0.0002, lr_0 = 9.2891e-04
Validation auc = 0.659107
Epoch 1430
Validation auc = 0.659052
Epoch 1431
Validation auc = 0.659162
Epoch 1432
Validation auc = 0.659052
Epoch 1433
Loss = 1.1932e-05, PNorm = 118.3179, GNorm = 0.0008, lr_0 = 9.2868e-04
Validation auc = 0.658943
Epoch 1434
Validation auc = 0.658780
Epoch 1435
Validation auc = 0.658507
Epoch 1436
Validation auc = 0.658398
Epoch 1437
Validation auc = 0.658398
Epoch 1438
Loss = 1.4633e-05, PNorm = 118.3192, GNorm = 0.0003, lr_0 = 9.2845e-04
Loss = 2.8014e-06, PNorm = 118.3193, GNorm = 0.0001, lr_0 = 9.2844e-04
Validation auc = 0.658344
Epoch 1439
Validation auc = 0.658398
Epoch 1440
Validation auc = 0.658398
Epoch 1441
Validation auc = 0.658344
Epoch 1442
Validation auc = 0.658344
Epoch 1443
Loss = 9.9750e-06, PNorm = 118.3203, GNorm = 0.0003, lr_0 = 9.2822e-04
Validation auc = 0.658398
Epoch 1444
Validation auc = 0.658398
Epoch 1445
Validation auc = 0.658235
Epoch 1446
Validation auc = 0.658126
Epoch 1447
Validation auc = 0.658126
Epoch 1448
Loss = 4.9543e-06, PNorm = 118.3215, GNorm = 0.0001, lr_0 = 9.2798e-04
Validation auc = 0.658126
Epoch 1449
Validation auc = 0.658071
Epoch 1450
Validation auc = 0.658017
Epoch 1451
Validation auc = 0.658180
Epoch 1452
Loss = 1.1187e-05, PNorm = 118.3223, GNorm = 0.0004, lr_0 = 9.2776e-04
Loss = 6.2187e-06, PNorm = 118.3224, GNorm = 0.0003, lr_0 = 9.2775e-04
Validation auc = 0.658235
Epoch 1453
Validation auc = 0.658725
Epoch 1454
Validation auc = 0.659162
Epoch 1455
Validation auc = 0.659216
Epoch 1456
Validation auc = 0.659434
Epoch 1457
Loss = 1.1155e-05, PNorm = 118.3233, GNorm = 0.0002, lr_0 = 9.2752e-04
Loss = 1.1821e-05, PNorm = 118.3233, GNorm = 0.0005, lr_0 = 9.2750e-04
Validation auc = 0.659543
Epoch 1458
Validation auc = 0.659489
Epoch 1459
Validation auc = 0.659598
Epoch 1460
Validation auc = 0.659652
Epoch 1461
Validation auc = 0.659652
Epoch 1462
Loss = 1.3794e-05, PNorm = 118.3243, GNorm = 0.0004, lr_0 = 9.2729e-04
Validation auc = 0.659652
Epoch 1463
Validation auc = 0.659652
Epoch 1464
Validation auc = 0.659707
Epoch 1465
Validation auc = 0.659707
Epoch 1466
Loss = 8.0966e-06, PNorm = 118.3253, GNorm = 0.0001, lr_0 = 9.2706e-04
Validation auc = 0.659816
Epoch 1467
Validation auc = 0.659816
Epoch 1468
Validation auc = 0.659761
Epoch 1469
Validation auc = 0.659652
Epoch 1470
Validation auc = 0.659707
Epoch 1471
Loss = 8.3957e-06, PNorm = 118.3265, GNorm = 0.0002, lr_0 = 9.2683e-04
Loss = 6.9539e-07, PNorm = 118.3266, GNorm = 0.0000, lr_0 = 9.2681e-04
Validation auc = 0.659761
Epoch 1472
Validation auc = 0.659652
Epoch 1473
Validation auc = 0.659543
Epoch 1474
Validation auc = 0.659216
Epoch 1475
Validation auc = 0.659052
Epoch 1476
Loss = 1.0657e-05, PNorm = 118.3277, GNorm = 0.0003, lr_0 = 9.2660e-04
Validation auc = 0.658725
Epoch 1477
Validation auc = 0.658725
Epoch 1478
Validation auc = 0.658671
Epoch 1479
Validation auc = 0.658453
Epoch 1480
Validation auc = 0.658453
Epoch 1481
Loss = 1.0988e-05, PNorm = 118.3289, GNorm = 0.0003, lr_0 = 9.2635e-04
Validation auc = 0.658507
Epoch 1482
Validation auc = 0.658453
Epoch 1483
Validation auc = 0.658616
Epoch 1484
Validation auc = 0.658671
Epoch 1485
Loss = 9.2203e-06, PNorm = 118.3298, GNorm = 0.0002, lr_0 = 9.2614e-04
Loss = 1.5159e-05, PNorm = 118.3299, GNorm = 0.0009, lr_0 = 9.2612e-04
Validation auc = 0.658398
Epoch 1486
Validation auc = 0.658235
Epoch 1487
Validation auc = 0.658126
Epoch 1488
Validation auc = 0.658071
Epoch 1489
Validation auc = 0.658017
Epoch 1490
Loss = 8.9297e-06, PNorm = 118.3311, GNorm = 0.0003, lr_0 = 9.2589e-04
Loss = 7.2121e-06, PNorm = 118.3312, GNorm = 0.0004, lr_0 = 9.2587e-04
Validation auc = 0.657962
Epoch 1491
Validation auc = 0.657799
Epoch 1492
Validation auc = 0.657799
Epoch 1493
Validation auc = 0.657744
Epoch 1494
Validation auc = 0.657853
Epoch 1495
Loss = 5.4406e-06, PNorm = 118.3320, GNorm = 0.0002, lr_0 = 9.2566e-04
Validation auc = 0.657853
Epoch 1496
Validation auc = 0.657799
Epoch 1497
Validation auc = 0.657799
Epoch 1498
Validation auc = 0.657853
Epoch 1499
Loss = 1.5878e-05, PNorm = 118.3329, GNorm = 0.0012, lr_0 = 9.2543e-04
Validation auc = 0.657962
Epoch 1500
Validation auc = 0.657962
Epoch 1501
Validation auc = 0.658017
Epoch 1502
Validation auc = 0.658126
Epoch 1503
Validation auc = 0.658071
Epoch 1504
Loss = 9.9011e-06, PNorm = 118.3339, GNorm = 0.0002, lr_0 = 9.2520e-04
Loss = 6.9141e-06, PNorm = 118.3340, GNorm = 0.0004, lr_0 = 9.2518e-04
Validation auc = 0.658126
Epoch 1505
Validation auc = 0.658126
Epoch 1506
Validation auc = 0.658180
Epoch 1507
Validation auc = 0.658180
Epoch 1508
Validation auc = 0.658126
Epoch 1509
Loss = 1.2673e-05, PNorm = 118.3350, GNorm = 0.0004, lr_0 = 9.2497e-04
Validation auc = 0.658180
Epoch 1510
Validation auc = 0.658235
Epoch 1511
Validation auc = 0.658180
Epoch 1512
Validation auc = 0.658180
Epoch 1513
Validation auc = 0.658289
Epoch 1514
Loss = 7.7890e-06, PNorm = 118.3366, GNorm = 0.0002, lr_0 = 9.2472e-04
Validation auc = 0.658344
Epoch 1515
Validation auc = 0.658344
Epoch 1516
Validation auc = 0.658344
Epoch 1517
Validation auc = 0.658344
Epoch 1518
Loss = 4.9781e-06, PNorm = 118.3378, GNorm = 0.0002, lr_0 = 9.2451e-04
Loss = 1.1106e-05, PNorm = 118.3379, GNorm = 0.0005, lr_0 = 9.2449e-04
Validation auc = 0.658344
Epoch 1519
Validation auc = 0.658398
Epoch 1520
Validation auc = 0.658344
Epoch 1521
Validation auc = 0.658344
Epoch 1522
Validation auc = 0.658289
Epoch 1523
Loss = 6.6421e-06, PNorm = 118.3388, GNorm = 0.0001, lr_0 = 9.2427e-04
Loss = 3.8345e-06, PNorm = 118.3389, GNorm = 0.0002, lr_0 = 9.2425e-04
Validation auc = 0.658235
Epoch 1524
Validation auc = 0.658235
Epoch 1525
Validation auc = 0.658180
Epoch 1526
Validation auc = 0.658180
Epoch 1527
Validation auc = 0.658453
Epoch 1528
Loss = 3.1271e-05, PNorm = 118.3396, GNorm = 0.0017, lr_0 = 9.2404e-04
Validation auc = 0.658507
Epoch 1529
Validation auc = 0.658507
Epoch 1530
Validation auc = 0.658453
Epoch 1531
Validation auc = 0.658507
Epoch 1532
Validation auc = 0.658453
Epoch 1533
Loss = 4.5465e-06, PNorm = 118.3405, GNorm = 0.0001, lr_0 = 9.2379e-04
Validation auc = 0.658562
Epoch 1534
Validation auc = 0.658562
Epoch 1535
Validation auc = 0.658562
Epoch 1536
Validation auc = 0.658616
Epoch 1537
Loss = 2.9456e-05, PNorm = 118.3414, GNorm = 0.0061, lr_0 = 9.2358e-04
Loss = 3.7551e-06, PNorm = 118.3415, GNorm = 0.0002, lr_0 = 9.2356e-04
Validation auc = 0.658507
Epoch 1538
Validation auc = 0.658071
Epoch 1539
Validation auc = 0.657989
Epoch 1540
Validation auc = 0.658126
Epoch 1541
Validation auc = 0.657853
Epoch 1542
Loss = 9.2285e-06, PNorm = 118.3430, GNorm = 0.0003, lr_0 = 9.2335e-04
Validation auc = 0.657744
Epoch 1543
Validation auc = 0.657853
Epoch 1544
Validation auc = 0.657744
Epoch 1545
Validation auc = 0.657581
Epoch 1546
Validation auc = 0.657635
Epoch 1547
Loss = 1.1968e-05, PNorm = 118.3443, GNorm = 0.0006, lr_0 = 9.2310e-04
Validation auc = 0.657635
Epoch 1548
Validation auc = 0.657526
Epoch 1549
Validation auc = 0.657690
Epoch 1550
Validation auc = 0.657635
Epoch 1551
Loss = 1.1506e-05, PNorm = 118.3452, GNorm = 0.0001, lr_0 = 9.2289e-04
Loss = 1.4007e-05, PNorm = 118.3453, GNorm = 0.0008, lr_0 = 9.2287e-04
Validation auc = 0.657635
Epoch 1552
Validation auc = 0.657690
Epoch 1553
Validation auc = 0.657690
Epoch 1554
Validation auc = 0.657635
Epoch 1555
Validation auc = 0.657635
Epoch 1556
Loss = 7.3561e-06, PNorm = 118.3461, GNorm = 0.0003, lr_0 = 9.2264e-04
Loss = 1.5895e-07, PNorm = 118.3461, GNorm = 0.0000, lr_0 = 9.2263e-04
Validation auc = 0.657635
Epoch 1557
Validation auc = 0.657417
Epoch 1558
Validation auc = 0.657199
Epoch 1559
Validation auc = 0.657308
Epoch 1560
Validation auc = 0.657417
Epoch 1561
Loss = 6.3373e-05, PNorm = 118.3470, GNorm = 0.0031, lr_0 = 9.2242e-04
Validation auc = 0.657362
Epoch 1562
Validation auc = 0.657362
Epoch 1563
Validation auc = 0.657417
Epoch 1564
Validation auc = 0.657362
Epoch 1565
Validation auc = 0.657308
Epoch 1566
Loss = 7.5171e-06, PNorm = 118.3481, GNorm = 0.0003, lr_0 = 9.2217e-04
Validation auc = 0.657362
Epoch 1567
Validation auc = 0.657253
Epoch 1568
Validation auc = 0.657199
Epoch 1569
Validation auc = 0.657962
Epoch 1570
Loss = 6.5993e-06, PNorm = 118.3494, GNorm = 0.0002, lr_0 = 9.2196e-04
Loss = 3.3378e-06, PNorm = 118.3496, GNorm = 0.0003, lr_0 = 9.2194e-04
Validation auc = 0.659052
Epoch 1571
Validation auc = 0.659707
Epoch 1572
Validation auc = 0.660034
Epoch 1573
Validation auc = 0.660524
Epoch 1574
Validation auc = 0.660906
Epoch 1575
Loss = 2.0474e-05, PNorm = 118.3519, GNorm = 0.0009, lr_0 = 9.2173e-04
Validation auc = 0.660961
Epoch 1576
Validation auc = 0.660961
Epoch 1577
Validation auc = 0.661233
Epoch 1578
Validation auc = 0.661451
Epoch 1579
Validation auc = 0.661615
Epoch 1580
Loss = 1.1756e-05, PNorm = 118.3542, GNorm = 0.0004, lr_0 = 9.2148e-04
Validation auc = 0.661887
Epoch 1581
Validation auc = 0.661887
Epoch 1582
Validation auc = 0.661887
Epoch 1583
Validation auc = 0.661724
Epoch 1584
Loss = 8.7997e-06, PNorm = 118.3555, GNorm = 0.0003, lr_0 = 9.2127e-04
Loss = 1.2974e-05, PNorm = 118.3556, GNorm = 0.0005, lr_0 = 9.2125e-04
Validation auc = 0.661615
Epoch 1585
Validation auc = 0.661615
Epoch 1586
Validation auc = 0.661669
Epoch 1587
Validation auc = 0.661724
Epoch 1588
Validation auc = 0.661724
Epoch 1589
Loss = 1.0158e-05, PNorm = 118.3568, GNorm = 0.0002, lr_0 = 9.2103e-04
Loss = 2.9979e-05, PNorm = 118.3569, GNorm = 0.0018, lr_0 = 9.2101e-04
Validation auc = 0.661615
Epoch 1590
Validation auc = 0.661615
Epoch 1591
Validation auc = 0.661669
Epoch 1592
Validation auc = 0.661724
Epoch 1593
Validation auc = 0.661778
Epoch 1594
Loss = 5.2117e-06, PNorm = 118.3581, GNorm = 0.0001, lr_0 = 9.2080e-04
Validation auc = 0.661724
Epoch 1595
Validation auc = 0.661724
Epoch 1596
Validation auc = 0.661778
Epoch 1597
Validation auc = 0.661669
Epoch 1598
Validation auc = 0.661833
Epoch 1599
Loss = 8.0368e-06, PNorm = 118.3592, GNorm = 0.0003, lr_0 = 9.2055e-04
Validation auc = 0.661724
Epoch 1600
Validation auc = 0.661887
Epoch 1601
Validation auc = 0.661887
Epoch 1602
Validation auc = 0.661942
Epoch 1603
Loss = 4.8792e-06, PNorm = 118.3601, GNorm = 0.0002, lr_0 = 9.2034e-04
Loss = 7.5499e-07, PNorm = 118.3601, GNorm = 0.0000, lr_0 = 9.2032e-04
Validation auc = 0.662051
Epoch 1604
Validation auc = 0.661887
Epoch 1605
Validation auc = 0.661887
Epoch 1606
Validation auc = 0.661833
Epoch 1607
Validation auc = 0.661669
Epoch 1608
Loss = 8.2358e-06, PNorm = 118.3610, GNorm = 0.0005, lr_0 = 9.2010e-04
Validation auc = 0.661506
Epoch 1609
Validation auc = 0.661451
Epoch 1610
Validation auc = 0.661397
Epoch 1611
Validation auc = 0.660906
Epoch 1612
Validation auc = 0.660688
Epoch 1613
Loss = 2.9540e-06, PNorm = 118.3615, GNorm = 0.0001, lr_0 = 9.1987e-04
Validation auc = 0.660633
Epoch 1614
Validation auc = 0.660524
Epoch 1615
Validation auc = 0.660470
Epoch 1616
Validation auc = 0.660197
Epoch 1617
Loss = 3.0407e-05, PNorm = 118.3621, GNorm = 0.0004, lr_0 = 9.1966e-04
Loss = 4.5498e-06, PNorm = 118.3621, GNorm = 0.0002, lr_0 = 9.1964e-04
Validation auc = 0.660088
Epoch 1618
Validation auc = 0.659707
Epoch 1619
Validation auc = 0.659652
Epoch 1620
Validation auc = 0.659707
Epoch 1621
Validation auc = 0.659707
Epoch 1622
Loss = 6.2702e-06, PNorm = 118.3631, GNorm = 0.0001, lr_0 = 9.1941e-04
Loss = 8.4041e-06, PNorm = 118.3631, GNorm = 0.0003, lr_0 = 9.1939e-04
Validation auc = 0.659707
Epoch 1623
Validation auc = 0.659598
Epoch 1624
Validation auc = 0.659652
Epoch 1625
Validation auc = 0.659707
Epoch 1626
Validation auc = 0.659652
Epoch 1627
Loss = 6.8520e-06, PNorm = 118.3639, GNorm = 0.0002, lr_0 = 9.1918e-04
Validation auc = 0.659652
Epoch 1628
Validation auc = 0.659489
Epoch 1629
Validation auc = 0.659489
Epoch 1630
Validation auc = 0.659052
Epoch 1631
Validation auc = 0.659052
Epoch 1632
Loss = 9.1759e-06, PNorm = 118.3646, GNorm = 0.0004, lr_0 = 9.1894e-04
Validation auc = 0.659052
Epoch 1633
Validation auc = 0.659052
Epoch 1634
Validation auc = 0.658889
Epoch 1635
Validation auc = 0.658889
Epoch 1636
Loss = 1.1861e-05, PNorm = 118.3654, GNorm = 0.0004, lr_0 = 9.1873e-04
Loss = 1.9272e-06, PNorm = 118.3655, GNorm = 0.0002, lr_0 = 9.1871e-04
Validation auc = 0.658725
Epoch 1637
Validation auc = 0.658889
Epoch 1638
Validation auc = 0.658834
Epoch 1639
Validation auc = 0.658780
Epoch 1640
Validation auc = 0.658780
Epoch 1641
Loss = 8.7193e-06, PNorm = 118.3667, GNorm = 0.0005, lr_0 = 9.1848e-04
Validation auc = 0.658616
Epoch 1642
Validation auc = 0.658616
Epoch 1643
Validation auc = 0.658671
Epoch 1644
Validation auc = 0.658780
Epoch 1645
Validation auc = 0.658725
Epoch 1646
Loss = 1.0223e-05, PNorm = 118.3681, GNorm = 0.0003, lr_0 = 9.1825e-04
Validation auc = 0.658889
Epoch 1647
Validation auc = 0.658834
Epoch 1648
Validation auc = 0.658889
Epoch 1649
Validation auc = 0.658943
Epoch 1650
Loss = 3.9696e-06, PNorm = 118.3691, GNorm = 0.0001, lr_0 = 9.1804e-04
Loss = 7.9473e-08, PNorm = 118.3692, GNorm = 0.0000, lr_0 = 9.1803e-04
Validation auc = 0.658943
Epoch 1651
Validation auc = 0.658780
Epoch 1652
Validation auc = 0.658725
Epoch 1653
Validation auc = 0.658780
Epoch 1654
Validation auc = 0.658780
Epoch 1655
Loss = 3.7991e-06, PNorm = 118.3702, GNorm = 0.0001, lr_0 = 9.1780e-04
Loss = 1.7722e-05, PNorm = 118.3703, GNorm = 0.0007, lr_0 = 9.1778e-04
Validation auc = 0.658780
Epoch 1656
Validation auc = 0.658943
Epoch 1657
Validation auc = 0.658943
Epoch 1658
Validation auc = 0.658780
Epoch 1659
Validation auc = 0.658780
Epoch 1660
Loss = 5.0496e-06, PNorm = 118.3712, GNorm = 0.0002, lr_0 = 9.1757e-04
Validation auc = 0.658780
Epoch 1661
Validation auc = 0.658780
Epoch 1662
Validation auc = 0.658671
Epoch 1663
Validation auc = 0.658616
Epoch 1664
Validation auc = 0.658616
Epoch 1665
Loss = 2.9921e-06, PNorm = 118.3720, GNorm = 0.0001, lr_0 = 9.1733e-04
Validation auc = 0.658616
Epoch 1666
Validation auc = 0.658671
Epoch 1667
Validation auc = 0.658671
Epoch 1668
Validation auc = 0.658562
Epoch 1669
Loss = 3.2973e-06, PNorm = 118.3725, GNorm = 0.0001, lr_0 = 9.1712e-04
Loss = 7.5499e-07, PNorm = 118.3726, GNorm = 0.0000, lr_0 = 9.1710e-04
Validation auc = 0.658562
Epoch 1670
Validation auc = 0.658507
Epoch 1671
Validation auc = 0.658507
Epoch 1672
Validation auc = 0.658507
Epoch 1673
Validation auc = 0.659761
Epoch 1674
Loss = 5.0663e-06, PNorm = 118.3749, GNorm = 0.0003, lr_0 = 9.1687e-04
Validation auc = 0.660088
Epoch 1675
Validation auc = 0.660633
Epoch 1676
Validation auc = 0.660852
Epoch 1677
Validation auc = 0.660961
Epoch 1678
Validation auc = 0.661124
Epoch 1679
Loss = 7.1856e-06, PNorm = 118.3778, GNorm = 0.0003, lr_0 = 9.1664e-04
Validation auc = 0.661070
Epoch 1680
Validation auc = 0.661070
Epoch 1681
Validation auc = 0.661179
Epoch 1682
Validation auc = 0.661124
Epoch 1683
Loss = 7.0384e-06, PNorm = 118.3797, GNorm = 0.0002, lr_0 = 9.1642e-04
Validation auc = 0.660961
Epoch 1684
Validation auc = 0.660961
Epoch 1685
Validation auc = 0.660906
Epoch 1686
Validation auc = 0.660797
Epoch 1687
Validation auc = 0.660797
Epoch 1688
Loss = 8.5825e-06, PNorm = 118.3810, GNorm = 0.0001, lr_0 = 9.1619e-04
Loss = 3.3577e-06, PNorm = 118.3811, GNorm = 0.0002, lr_0 = 9.1617e-04
Validation auc = 0.661015
Epoch 1689
Validation auc = 0.660961
Epoch 1690
Validation auc = 0.661015
Epoch 1691
Validation auc = 0.660961
Epoch 1692
Validation auc = 0.661015
Epoch 1693
Loss = 3.8170e-06, PNorm = 118.3823, GNorm = 0.0002, lr_0 = 9.1596e-04
Validation auc = 0.660906
Epoch 1694
Validation auc = 0.660852
Epoch 1695
Validation auc = 0.660852
Epoch 1696
Validation auc = 0.660906
Epoch 1697
Validation auc = 0.660961
Epoch 1698
Loss = 7.3454e-06, PNorm = 118.3832, GNorm = 0.0002, lr_0 = 9.1572e-04
Validation auc = 0.661070
Epoch 1699
Validation auc = 0.660961
Epoch 1700
Validation auc = 0.660852
Epoch 1701
Validation auc = 0.660797
Epoch 1702
Loss = 4.1936e-06, PNorm = 118.3839, GNorm = 0.0001, lr_0 = 9.1551e-04
Loss = 4.3710e-06, PNorm = 118.3839, GNorm = 0.0002, lr_0 = 9.1549e-04
Validation auc = 0.660797
Epoch 1703
Validation auc = 0.660797
Epoch 1704
Validation auc = 0.660852
Epoch 1705
Validation auc = 0.660852
Epoch 1706
Validation auc = 0.660743
Epoch 1707
Loss = 5.5703e-06, PNorm = 118.3845, GNorm = 0.0003, lr_0 = 9.1526e-04
Loss = 2.4636e-06, PNorm = 118.3845, GNorm = 0.0001, lr_0 = 9.1525e-04
Validation auc = 0.660688
Epoch 1708
Validation auc = 0.660633
Epoch 1709
Validation auc = 0.660633
Epoch 1710
Validation auc = 0.660688
Epoch 1711
Validation auc = 0.660633
Epoch 1712
Loss = 3.0565e-06, PNorm = 118.3852, GNorm = 0.0001, lr_0 = 9.1504e-04
Validation auc = 0.660633
Epoch 1713
Validation auc = 0.660633
Epoch 1714
Validation auc = 0.660633
Epoch 1715
Validation auc = 0.660524
Epoch 1716
Loss = 3.1494e-06, PNorm = 118.3857, GNorm = 0.0000, lr_0 = 9.1481e-04
Validation auc = 0.660579
Epoch 1717
Validation auc = 0.660415
Epoch 1718
Validation auc = 0.660415
Epoch 1719
Validation auc = 0.660088
Epoch 1720
Validation auc = 0.659816
Epoch 1721
Loss = 2.7227e-06, PNorm = 118.3863, GNorm = 0.0001, lr_0 = 9.1458e-04
Loss = 3.2782e-06, PNorm = 118.3864, GNorm = 0.0002, lr_0 = 9.1457e-04
Validation auc = 0.659816
Epoch 1722
Validation auc = 0.659816
Epoch 1723
Validation auc = 0.659761
Epoch 1724
Validation auc = 0.659707
Epoch 1725
Validation auc = 0.659816
Epoch 1726
Loss = 3.1614e-06, PNorm = 118.3867, GNorm = 0.0001, lr_0 = 9.1436e-04
Validation auc = 0.659925
Epoch 1727
Validation auc = 0.659870
Epoch 1728
Validation auc = 0.659979
Epoch 1729
Validation auc = 0.660143
Epoch 1730
Validation auc = 0.660306
Epoch 1731
Loss = 2.9158e-06, PNorm = 118.3864, GNorm = 0.0001, lr_0 = 9.1411e-04
Validation auc = 0.660415
Epoch 1732
Validation auc = 0.660415
Epoch 1733
Validation auc = 0.660415
Epoch 1734
Validation auc = 0.660415
Epoch 1735
Loss = 4.4499e-06, PNorm = 118.3868, GNorm = 0.0001, lr_0 = 9.1390e-04
Loss = 1.4901e-06, PNorm = 118.3868, GNorm = 0.0001, lr_0 = 9.1389e-04
Validation auc = 0.660415
Epoch 1736
Validation auc = 0.660415
Epoch 1737
Validation auc = 0.660361
Epoch 1738
Validation auc = 0.660361
Epoch 1739
Validation auc = 0.660415
Epoch 1740
Loss = 5.8062e-06, PNorm = 118.3874, GNorm = 0.0008, lr_0 = 9.1366e-04
Loss = 1.6093e-06, PNorm = 118.3874, GNorm = 0.0001, lr_0 = 9.1364e-04
Validation auc = 0.660361
Epoch 1741
Validation auc = 0.660361
Epoch 1742
Validation auc = 0.660415
Epoch 1743
Validation auc = 0.660415
Epoch 1744
Validation auc = 0.660361
Epoch 1745
Loss = 1.6505e-05, PNorm = 118.3878, GNorm = 0.0012, lr_0 = 9.1343e-04
Validation auc = 0.660361
Epoch 1746
Validation auc = 0.660361
Epoch 1747
Validation auc = 0.660306
Epoch 1748
Validation auc = 0.660197
Epoch 1749
Loss = 4.4741e-06, PNorm = 118.3882, GNorm = 0.0000, lr_0 = 9.1320e-04
Validation auc = 0.660197
Epoch 1750
Validation auc = 0.660143
Epoch 1751
Validation auc = 0.660143
Epoch 1752
Validation auc = 0.660143
Epoch 1753
Validation auc = 0.660088
Epoch 1754
Loss = 9.9077e-06, PNorm = 118.3887, GNorm = 0.0014, lr_0 = 9.1298e-04
Loss = 5.1260e-06, PNorm = 118.3888, GNorm = 0.0002, lr_0 = 9.1296e-04
Validation auc = 0.660088
Epoch 1755
Validation auc = 0.660143
Epoch 1756
Validation auc = 0.660088
Epoch 1757
Validation auc = 0.660088
Epoch 1758
Validation auc = 0.660088
Epoch 1759
Loss = 2.0671e-06, PNorm = 118.3893, GNorm = 0.0001, lr_0 = 9.1275e-04
Validation auc = 0.660034
Epoch 1760
Validation auc = 0.659870
Epoch 1761
Validation auc = 0.659761
Epoch 1762
Validation auc = 0.659707
Epoch 1763
Validation auc = 0.659652
Epoch 1764
Loss = 2.9015e-06, PNorm = 118.3899, GNorm = 0.0001, lr_0 = 9.1251e-04
Validation auc = 0.659598
Epoch 1765
Validation auc = 0.659707
Epoch 1766
Validation auc = 0.659652
Epoch 1767
Validation auc = 0.659652
Epoch 1768
Loss = 2.6142e-06, PNorm = 118.3903, GNorm = 0.0001, lr_0 = 9.1230e-04
Loss = 4.8478e-06, PNorm = 118.3904, GNorm = 0.0002, lr_0 = 9.1228e-04
Validation auc = 0.659543
Epoch 1769
Validation auc = 0.659543
Epoch 1770
Validation auc = 0.659652
Epoch 1771
Validation auc = 0.659652
Epoch 1772
Validation auc = 0.659598
Epoch 1773
Loss = 2.0587e-06, PNorm = 118.3910, GNorm = 0.0000, lr_0 = 9.1206e-04
Loss = 3.7750e-07, PNorm = 118.3911, GNorm = 0.0000, lr_0 = 9.1204e-04
Validation auc = 0.659434
Epoch 1774
Validation auc = 0.659489
Epoch 1775
Validation auc = 0.659543
Epoch 1776
Validation auc = 0.659489
Epoch 1777
Validation auc = 0.659489
Epoch 1778
Loss = 2.2673e-06, PNorm = 118.3916, GNorm = 0.0001, lr_0 = 9.1183e-04
Validation auc = 0.659325
Epoch 1779
Validation auc = 0.659325
Epoch 1780
Validation auc = 0.659325
Epoch 1781
Validation auc = 0.659543
Epoch 1782
Validation auc = 0.659434
Epoch 1783
Loss = 2.8014e-06, PNorm = 118.3923, GNorm = 0.0001, lr_0 = 9.1159e-04
Validation auc = 0.659489
Epoch 1784
Validation auc = 0.659543
Epoch 1785
Validation auc = 0.659543
Epoch 1786
Validation auc = 0.659652
Epoch 1787
Loss = 4.6574e-06, PNorm = 118.3928, GNorm = 0.0002, lr_0 = 9.1138e-04
Loss = 5.7418e-06, PNorm = 118.3929, GNorm = 0.0002, lr_0 = 9.1136e-04
Validation auc = 0.659652
Epoch 1788
Validation auc = 0.659761
Epoch 1789
Validation auc = 0.659761
Epoch 1790
Validation auc = 0.659761
Epoch 1791
Validation auc = 0.659925
Epoch 1792
Loss = 2.1219e-06, PNorm = 118.3933, GNorm = 0.0001, lr_0 = 9.1115e-04
Validation auc = 0.659925
Epoch 1793
Validation auc = 0.659652
Epoch 1794
Validation auc = 0.659707
Epoch 1795
Validation auc = 0.659707
Epoch 1796
Validation auc = 0.659652
Epoch 1797
Loss = 2.7179e-06, PNorm = 118.3940, GNorm = 0.0001, lr_0 = 9.1091e-04
Validation auc = 0.659598
Epoch 1798
Validation auc = 0.659598
Epoch 1799
Validation auc = 0.659543
Epoch 1800
Validation auc = 0.659489
Epoch 1801
Loss = 1.1064e-05, PNorm = 118.3948, GNorm = 0.0013, lr_0 = 9.1070e-04
Loss = 2.4636e-06, PNorm = 118.3949, GNorm = 0.0001, lr_0 = 9.1068e-04
Validation auc = 0.659434
Epoch 1802
Validation auc = 0.659543
Epoch 1803
Validation auc = 0.659543
Epoch 1804
Validation auc = 0.659652
Epoch 1805
Validation auc = 0.659652
Epoch 1806
Loss = 4.9097e-06, PNorm = 118.3958, GNorm = 0.0000, lr_0 = 9.1046e-04
Loss = 3.1193e-06, PNorm = 118.3958, GNorm = 0.0002, lr_0 = 9.1044e-04
Validation auc = 0.659543
Epoch 1807
Validation auc = 0.659543
Epoch 1808
Validation auc = 0.659543
Epoch 1809
Validation auc = 0.659543
Epoch 1810
Validation auc = 0.659598
Epoch 1811
Loss = 2.9444e-06, PNorm = 118.3963, GNorm = 0.0001, lr_0 = 9.1023e-04
Validation auc = 0.659598
Epoch 1812
Validation auc = 0.659707
Epoch 1813
Validation auc = 0.659707
Epoch 1814
Validation auc = 0.659707
Epoch 1815
Validation auc = 0.659652
Epoch 1816
Loss = 2.3555e-06, PNorm = 118.3968, GNorm = 0.0001, lr_0 = 9.0999e-04
Validation auc = 0.659652
Epoch 1817
Validation auc = 0.659652
Epoch 1818
Validation auc = 0.659598
Epoch 1819
Validation auc = 0.659598
Epoch 1820
Loss = 2.4688e-06, PNorm = 118.3981, GNorm = 0.0001, lr_0 = 9.0978e-04
Loss = 2.4239e-06, PNorm = 118.3983, GNorm = 0.0001, lr_0 = 9.0976e-04
Validation auc = 0.659162
Epoch 1821
Validation auc = 0.658943
Epoch 1822
Validation auc = 0.658616
Epoch 1823
Validation auc = 0.658562
Epoch 1824
Validation auc = 0.658507
Epoch 1825
Loss = 3.0994e-06, PNorm = 118.4000, GNorm = 0.0001, lr_0 = 9.0955e-04
Validation auc = 0.658453
Epoch 1826
Validation auc = 0.658071
Epoch 1827
Validation auc = 0.658180
Epoch 1828
Validation auc = 0.658180
Epoch 1829
Validation auc = 0.658235
Epoch 1830
Loss = 4.0936e-06, PNorm = 118.4016, GNorm = 0.0001, lr_0 = 9.0931e-04
Validation auc = 0.658180
Epoch 1831
Validation auc = 0.658289
Epoch 1832
Validation auc = 0.658344
Epoch 1833
Validation auc = 0.658344
Epoch 1834
Loss = 4.5739e-06, PNorm = 118.4027, GNorm = 0.0001, lr_0 = 9.0910e-04
Loss = 1.3411e-05, PNorm = 118.4028, GNorm = 0.0007, lr_0 = 9.0909e-04
Validation auc = 0.658398
Epoch 1835
Validation auc = 0.658235
Epoch 1836
Validation auc = 0.658235
Epoch 1837
Validation auc = 0.658235
Epoch 1838
Validation auc = 0.658071
Epoch 1839
Loss = 2.0337e-06, PNorm = 118.4038, GNorm = 0.0001, lr_0 = 9.0886e-04
Loss = 3.1789e-07, PNorm = 118.4039, GNorm = 0.0000, lr_0 = 9.0884e-04
Validation auc = 0.658126
Epoch 1840
Validation auc = 0.658289
Epoch 1841
Validation auc = 0.658289
Epoch 1842
Validation auc = 0.658235
Epoch 1843
Validation auc = 0.658235
Epoch 1844
Loss = 3.7860e-06, PNorm = 118.4045, GNorm = 0.0001, lr_0 = 9.0863e-04
Validation auc = 0.658235
Epoch 1845
Validation auc = 0.658180
Epoch 1846
Validation auc = 0.658126
Epoch 1847
Validation auc = 0.658071
Epoch 1848
Validation auc = 0.657962
Epoch 1849
Loss = 1.8406e-06, PNorm = 118.4052, GNorm = 0.0001, lr_0 = 9.0839e-04
Validation auc = 0.658126
Epoch 1850
Validation auc = 0.658126
Epoch 1851
Validation auc = 0.657581
Epoch 1852
Validation auc = 0.657690
Epoch 1853
Loss = 1.8954e-06, PNorm = 118.4063, GNorm = 0.0000, lr_0 = 9.0818e-04
Loss = 1.1921e-07, PNorm = 118.4064, GNorm = 0.0000, lr_0 = 9.0817e-04
Validation auc = 0.657799
Epoch 1854
Validation auc = 0.657853
Epoch 1855
Validation auc = 0.658180
Epoch 1856
Validation auc = 0.658126
Epoch 1857
Validation auc = 0.658126
Epoch 1858
Loss = 1.8787e-06, PNorm = 118.4072, GNorm = 0.0001, lr_0 = 9.0794e-04
Validation auc = 0.658126
Epoch 1859
Validation auc = 0.658235
Epoch 1860
Validation auc = 0.658235
Epoch 1861
Validation auc = 0.658126
Epoch 1862
Validation auc = 0.658126
Epoch 1863
Loss = 2.9849e-06, PNorm = 118.4077, GNorm = 0.0002, lr_0 = 9.0772e-04
Validation auc = 0.658126
Epoch 1864
Validation auc = 0.658126
Epoch 1865
Validation auc = 0.657962
Epoch 1866
Validation auc = 0.657908
Epoch 1867
Loss = 2.4282e-06, PNorm = 118.4081, GNorm = 0.0001, lr_0 = 9.0751e-04
Loss = 0.0000e+00, PNorm = 118.4081, GNorm = 0.0000, lr_0 = 9.0749e-04
Validation auc = 0.657962
Epoch 1868
Validation auc = 0.657908
Epoch 1869
Validation auc = 0.657962
Epoch 1870
Validation auc = 0.658017
Epoch 1871
Validation auc = 0.657962
Epoch 1872
Loss = 6.3414e-06, PNorm = 118.4086, GNorm = 0.0002, lr_0 = 9.0727e-04
Loss = 2.7418e-06, PNorm = 118.4087, GNorm = 0.0002, lr_0 = 9.0725e-04
Validation auc = 0.657962
Epoch 1873
Validation auc = 0.657962
Epoch 1874
Validation auc = 0.657962
Epoch 1875
Validation auc = 0.657962
Epoch 1876
Validation auc = 0.657962
Epoch 1877
Loss = 8.3208e-07, PNorm = 118.4091, GNorm = 0.0000, lr_0 = 9.0704e-04
Validation auc = 0.658126
Epoch 1878
Validation auc = 0.658235
Epoch 1879
Validation auc = 0.658344
Epoch 1880
Validation auc = 0.658507
Epoch 1881
Validation auc = 0.658507
Epoch 1882
Loss = 1.4305e-06, PNorm = 118.4097, GNorm = 0.0000, lr_0 = 9.0680e-04
Validation auc = 0.658398
Epoch 1883
Validation auc = 0.658398
Epoch 1884
Validation auc = 0.658344
Epoch 1885
Validation auc = 0.658453
Epoch 1886
Loss = 1.9085e-06, PNorm = 118.4101, GNorm = 0.0000, lr_0 = 9.0659e-04
Loss = 1.4305e-06, PNorm = 118.4101, GNorm = 0.0001, lr_0 = 9.0657e-04
Validation auc = 0.658671
Epoch 1887
Validation auc = 0.658671
Epoch 1888
Validation auc = 0.658453
Epoch 1889
Validation auc = 0.658616
Epoch 1890
Validation auc = 0.658889
Epoch 1891
Loss = 3.1948e-06, PNorm = 118.4110, GNorm = 0.0002, lr_0 = 9.0635e-04
Validation auc = 0.659052
Epoch 1892
Validation auc = 0.658998
Epoch 1893
Validation auc = 0.658943
Epoch 1894
Validation auc = 0.659052
Epoch 1895
Validation auc = 0.658889
Epoch 1896
Loss = 4.2938e-06, PNorm = 118.4121, GNorm = 0.0002, lr_0 = 9.0612e-04
Validation auc = 0.658943
Epoch 1897
Validation auc = 0.658943
Epoch 1898
Validation auc = 0.659107
Epoch 1899
Validation auc = 0.658998
Epoch 1900
Loss = 2.5141e-06, PNorm = 118.4131, GNorm = 0.0002, lr_0 = 9.0592e-04
Loss = 4.8081e-06, PNorm = 118.4132, GNorm = 0.0003, lr_0 = 9.0590e-04
Validation auc = 0.658998
Epoch 1901
Validation auc = 0.659107
Epoch 1902
Validation auc = 0.659052
Epoch 1903
Validation auc = 0.659052
Epoch 1904
Validation auc = 0.658943
Epoch 1905
Loss = 2.0861e-06, PNorm = 118.4142, GNorm = 0.0001, lr_0 = 9.0567e-04
Loss = 2.3047e-06, PNorm = 118.4142, GNorm = 0.0001, lr_0 = 9.0566e-04
Validation auc = 0.658998
Epoch 1906
Validation auc = 0.659107
Epoch 1907
Validation auc = 0.659107
Epoch 1908
Validation auc = 0.659107
Epoch 1909
Validation auc = 0.659107
Epoch 1910
Loss = 1.3661e-06, PNorm = 118.4149, GNorm = 0.0001, lr_0 = 9.0545e-04
Validation auc = 0.659107
Epoch 1911
Validation auc = 0.659107
Epoch 1912
Validation auc = 0.659052
Epoch 1913
Validation auc = 0.659052
Epoch 1914
Validation auc = 0.659052
Epoch 1915
Loss = 2.8562e-06, PNorm = 118.4155, GNorm = 0.0001, lr_0 = 9.0521e-04
Validation auc = 0.658834
Epoch 1916
Validation auc = 0.658616
Epoch 1917
Validation auc = 0.658725
Epoch 1918
Validation auc = 0.658616
Epoch 1919
Loss = 3.3819e-06, PNorm = 118.4160, GNorm = 0.0004, lr_0 = 9.0500e-04
Loss = 4.7484e-06, PNorm = 118.4161, GNorm = 0.0004, lr_0 = 9.0498e-04
Validation auc = 0.658562
Epoch 1920
Validation auc = 0.658616
Epoch 1921
Validation auc = 0.658671
Epoch 1922
Validation auc = 0.658671
Epoch 1923
Validation auc = 0.658616
Epoch 1924
Loss = 6.3116e-06, PNorm = 118.4168, GNorm = 0.0005, lr_0 = 9.0476e-04
Validation auc = 0.658671
Epoch 1925
Validation auc = 0.658671
Epoch 1926
Validation auc = 0.658671
Epoch 1927
Validation auc = 0.658780
Epoch 1928
Validation auc = 0.658725
Epoch 1929
Loss = 2.4747e-06, PNorm = 118.4175, GNorm = 0.0001, lr_0 = 9.0454e-04
Validation auc = 0.658671
Epoch 1930
Validation auc = 0.658562
Epoch 1931
Validation auc = 0.658616
Epoch 1932
Validation auc = 0.658780
Epoch 1933
Loss = 1.3290e-06, PNorm = 118.4182, GNorm = 0.0000, lr_0 = 9.0431e-04
Validation auc = 0.658780
Epoch 1934
Validation auc = 0.658834
Epoch 1935
Validation auc = 0.658616
Epoch 1936
Validation auc = 0.658562
Epoch 1937
Validation auc = 0.658398
Epoch 1938
Loss = 8.9287e-07, PNorm = 118.4188, GNorm = 0.0000, lr_0 = 9.0409e-04
Loss = 2.3842e-07, PNorm = 118.4188, GNorm = 0.0000, lr_0 = 9.0407e-04
Validation auc = 0.658344
Epoch 1939
Validation auc = 0.658289
Epoch 1940
Validation auc = 0.658344
Epoch 1941
Validation auc = 0.658289
Epoch 1942
Validation auc = 0.658289
Epoch 1943
Loss = 8.2969e-07, PNorm = 118.4193, GNorm = 0.0000, lr_0 = 9.0386e-04
Validation auc = 0.658344
Epoch 1944
Validation auc = 0.658289
Epoch 1945
Validation auc = 0.658344
Epoch 1946
Validation auc = 0.658398
Epoch 1947
Validation auc = 0.658398
Epoch 1948
Loss = 1.6141e-06, PNorm = 118.4197, GNorm = 0.0001, lr_0 = 9.0362e-04
Validation auc = 0.658398
Epoch 1949
Validation auc = 0.658398
Epoch 1950
Validation auc = 0.658344
Epoch 1951
Validation auc = 0.658398
Epoch 1952
Loss = 9.3221e-07, PNorm = 118.4201, GNorm = 0.0000, lr_0 = 9.0341e-04
Loss = 0.0000e+00, PNorm = 118.4201, GNorm = 0.0000, lr_0 = 9.0340e-04
Validation auc = 0.658289
Epoch 1953
Validation auc = 0.658344
Epoch 1954
Validation auc = 0.658398
Epoch 1955
Validation auc = 0.658398
Epoch 1956
Validation auc = 0.658398
Epoch 1957
Loss = 1.5092e-06, PNorm = 118.4204, GNorm = 0.0001, lr_0 = 9.0317e-04
Loss = 1.3908e-07, PNorm = 118.4205, GNorm = 0.0000, lr_0 = 9.0316e-04
Validation auc = 0.658398
Epoch 1958
Validation auc = 0.658344
Epoch 1959
Validation auc = 0.658126
Epoch 1960
Validation auc = 0.658180
Epoch 1961
Validation auc = 0.657744
Epoch 1962
Loss = 2.3818e-06, PNorm = 118.4213, GNorm = 0.0001, lr_0 = 9.0295e-04
Validation auc = 0.657799
Epoch 1963
Validation auc = 0.657581
Epoch 1964
Validation auc = 0.657417
Epoch 1965
Validation auc = 0.657362
Epoch 1966
Loss = 1.1433e-06, PNorm = 118.4223, GNorm = 0.0000, lr_0 = 9.0273e-04
Validation auc = 0.657417
Epoch 1967
Validation auc = 0.657417
Epoch 1968
Validation auc = 0.657417
Epoch 1969
Validation auc = 0.657308
Epoch 1970
Validation auc = 0.657362
Epoch 1971
Loss = 1.4913e-06, PNorm = 118.4226, GNorm = 0.0001, lr_0 = 9.0250e-04
Loss = 4.1723e-07, PNorm = 118.4226, GNorm = 0.0000, lr_0 = 9.0249e-04
Validation auc = 0.657581
Epoch 1972
Validation auc = 0.657253
Epoch 1973
Validation auc = 0.656981
Epoch 1974
Validation auc = 0.657035
Epoch 1975
Validation auc = 0.657035
Epoch 1976
Loss = 4.0768e-06, PNorm = 118.4228, GNorm = 0.0002, lr_0 = 9.0228e-04
Validation auc = 0.657090
Epoch 1977
Validation auc = 0.657199
Epoch 1978
Validation auc = 0.657308
Epoch 1979
Validation auc = 0.657362
Epoch 1980
Validation auc = 0.657308
Epoch 1981
Loss = 1.1301e-06, PNorm = 118.4233, GNorm = 0.0000, lr_0 = 9.0204e-04
Validation auc = 0.657308
Epoch 1982
Validation auc = 0.657362
Epoch 1983
Validation auc = 0.657362
Epoch 1984
Validation auc = 0.657417
Epoch 1985
Loss = 1.8835e-06, PNorm = 118.4240, GNorm = 0.0001, lr_0 = 9.0183e-04
Loss = 7.9473e-08, PNorm = 118.4240, GNorm = 0.0000, lr_0 = 9.0181e-04
Validation auc = 0.657417
Epoch 1986
Validation auc = 0.657417
Epoch 1987
Validation auc = 0.657417
Epoch 1988
Validation auc = 0.657417
Epoch 1989
Validation auc = 0.657472
Epoch 1990
Loss = 1.1229e-06, PNorm = 118.4246, GNorm = 0.0000, lr_0 = 9.0159e-04
Loss = 5.9605e-07, PNorm = 118.4247, GNorm = 0.0000, lr_0 = 9.0157e-04
Validation auc = 0.657472
Epoch 1991
Validation auc = 0.657417
Epoch 1992
Validation auc = 0.657308
Epoch 1993
Validation auc = 0.657253
Epoch 1994
Validation auc = 0.657362
Epoch 1995
Loss = 4.6497e-05, PNorm = 118.4252, GNorm = 0.0047, lr_0 = 9.0137e-04
Validation auc = 0.656763
Epoch 1996
Validation auc = 0.656163
Epoch 1997
Validation auc = 0.656054
Epoch 1998
Validation auc = 0.656054
Epoch 1999
Loss = 1.4339e-06, PNorm = 118.4260, GNorm = 0.0001, lr_0 = 9.0114e-04
Validation auc = 0.655891
Model 0 best validation auc = 0.749714 on epoch 372
Loading pretrained parameter "encoder.encoder.0.cached_zero_vector".
Loading pretrained parameter "encoder.encoder.0.W_i.weight".
Loading pretrained parameter "encoder.encoder.0.W_h.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.bias".
Loading pretrained parameter "ffn.1.weight".
Loading pretrained parameter "ffn.1.bias".
Moving model to cuda
Model 0 test auc = 0.615602
Ensemble test auc = 0.615602
Fold 1
Splitting data with seed 1
Class sizes
sars_cov_two_active 0: 98.39%, 1: 1.61%
Total size = 3,294 | train size = 3,294 | val size = 1,096 | test size = 1,086
With class_balance, effective train size = 106
Building model 0
MoleculeModel(
  (sigmoid): Sigmoid()
  (encoder): MPN(
    (encoder): ModuleList(
      (0): MPNEncoder(
        (dropout_layer): Dropout(p=0.05, inplace=False)
        (act_func): ReLU()
        (W_i): Linear(in_features=147, out_features=2100, bias=False)
        (W_h): Linear(in_features=2100, out_features=2100, bias=False)
        (W_o): Linear(in_features=2233, out_features=2100, bias=True)
      )
    )
  )
  (ffn): Sequential(
    (0): Dropout(p=0.05, inplace=False)
    (1): Linear(in_features=2328, out_features=1, bias=True)
  )
)
Number of parameters = 9,412,429
Moving model to cuda
Epoch 0
Validation auc = 0.429701
Epoch 1
Validation auc = 0.632394
Epoch 2
Validation auc = 0.612277
Epoch 3
Validation auc = 0.572862
Epoch 4
Loss = 7.0804e-01, PNorm = 67.4089, GNorm = 1.0906, lr_0 = 2.0385e-04
Loss = 7.3489e-01, PNorm = 67.4108, GNorm = 2.7020, lr_0 = 2.1077e-04
Validation auc = 0.604536
Epoch 5
Validation auc = 0.617947
Epoch 6
Validation auc = 0.599520
Epoch 7
Validation auc = 0.629395
Epoch 8
Validation auc = 0.585346
Epoch 9
Loss = 6.9149e-01, PNorm = 67.4480, GNorm = 2.3182, lr_0 = 3.0077e-04
Validation auc = 0.598103
Epoch 10
Validation auc = 0.622472
Epoch 11
Validation auc = 0.649349
Epoch 12
Validation auc = 0.637573
Epoch 13
Validation auc = 0.661233
Epoch 14
Loss = 6.5103e-01, PNorm = 67.5267, GNorm = 1.1817, lr_0 = 4.0462e-04
Validation auc = 0.674862
Epoch 15
Validation auc = 0.676770
Epoch 16
Validation auc = 0.640190
Epoch 17
Validation auc = 0.624216
Epoch 18
Loss = 7.1116e-01, PNorm = 67.6161, GNorm = 1.0707, lr_0 = 4.9462e-04
Loss = 6.4777e-01, PNorm = 67.6235, GNorm = 2.9321, lr_0 = 5.0154e-04
Validation auc = 0.635174
Epoch 19
Validation auc = 0.636973
Epoch 20
Validation auc = 0.625143
Epoch 21
Validation auc = 0.608679
Epoch 22
Validation auc = 0.598157
Epoch 23
Loss = 6.5577e-01, PNorm = 67.7599, GNorm = 0.7802, lr_0 = 5.9846e-04
Loss = 6.4351e-01, PNorm = 67.7693, GNorm = 1.9178, lr_0 = 6.0538e-04
Validation auc = 0.598866
Epoch 24
Validation auc = 0.615712
Epoch 25
Validation auc = 0.628850
Epoch 26
Validation auc = 0.655836
Epoch 27
Validation auc = 0.641771
Epoch 28
Loss = 7.7705e-01, PNorm = 67.9372, GNorm = 4.4353, lr_0 = 6.9538e-04
Validation auc = 0.659216
Epoch 29
Validation auc = 0.638609
Epoch 30
Validation auc = 0.635828
Epoch 31
Validation auc = 0.628305
Epoch 32
Validation auc = 0.621654
Epoch 33
Loss = 5.9882e-01, PNorm = 68.1677, GNorm = 1.2346, lr_0 = 7.9923e-04
Validation auc = 0.601755
Epoch 34
Validation auc = 0.597340
Epoch 35
Validation auc = 0.600720
Epoch 36
Validation auc = 0.623889
Epoch 37
Loss = 5.8688e-01, PNorm = 68.4044, GNorm = 0.8292, lr_0 = 8.8923e-04
Loss = 4.9604e-01, PNorm = 68.4245, GNorm = 1.7471, lr_0 = 8.9615e-04
Validation auc = 0.644497
Epoch 38
Validation auc = 0.658126
Epoch 39
Validation auc = 0.660361
Epoch 40
Validation auc = 0.646623
Epoch 41
Validation auc = 0.609224
Epoch 42
Loss = 5.3179e-01, PNorm = 68.7147, GNorm = 0.8611, lr_0 = 9.8615e-04
Validation auc = 0.635447
Epoch 43
Validation auc = 0.635120
Epoch 44
Validation auc = 0.615821
Epoch 45
Validation auc = 0.630104
Epoch 46
Validation auc = 0.623235
Epoch 47
Loss = 5.7835e-01, PNorm = 69.1384, GNorm = 0.9497, lr_0 = 9.9977e-04
Validation auc = 0.636973
Epoch 48
Validation auc = 0.638118
Epoch 49
Validation auc = 0.602083
Epoch 50
Validation auc = 0.570463
Epoch 51
Loss = 5.8634e-01, PNorm = 69.5145, GNorm = 1.0051, lr_0 = 9.9954e-04
Loss = 6.4986e-01, PNorm = 69.5378, GNorm = 2.4541, lr_0 = 9.9952e-04
Validation auc = 0.566102
Epoch 52
Validation auc = 0.572207
Epoch 53
Validation auc = 0.598048
Epoch 54
Validation auc = 0.629286
Epoch 55
Validation auc = 0.649185
Epoch 56
Loss = 6.5972e-01, PNorm = 69.8937, GNorm = 2.4260, lr_0 = 9.9927e-04
Loss = 6.8714e-01, PNorm = 69.9218, GNorm = 1.5787, lr_0 = 9.9926e-04
Validation auc = 0.664286
Epoch 57
Validation auc = 0.670228
Epoch 58
Validation auc = 0.652892
Epoch 59
Validation auc = 0.652074
Epoch 60
Validation auc = 0.643079
Epoch 61
Loss = 5.1836e-01, PNorm = 70.3367, GNorm = 1.1841, lr_0 = 9.9903e-04
Validation auc = 0.626397
Epoch 62
Validation auc = 0.522870
Epoch 63
Validation auc = 0.634684
Epoch 64
Validation auc = 0.624980
Epoch 65
Validation auc = 0.621654
Epoch 66
Loss = 5.5862e-01, PNorm = 70.9861, GNorm = 0.7653, lr_0 = 9.9876e-04
Validation auc = 0.623562
Epoch 67
Validation auc = 0.629832
Epoch 68
Validation auc = 0.659543
Epoch 69
Validation auc = 0.669956
Epoch 70
Loss = 5.5139e-01, PNorm = 71.5111, GNorm = 1.7182, lr_0 = 9.9853e-04
Loss = 3.7833e-01, PNorm = 71.5443, GNorm = 2.1166, lr_0 = 9.9851e-04
Validation auc = 0.659870
Epoch 71
Validation auc = 0.664668
Epoch 72
Validation auc = 0.671046
Epoch 73
Validation auc = 0.661724
Epoch 74
Validation auc = 0.650112
Epoch 75
Loss = 4.4057e-01, PNorm = 72.0128, GNorm = 0.7583, lr_0 = 9.9828e-04
Validation auc = 0.663632
Epoch 76
Validation auc = 0.655836
Epoch 77
Validation auc = 0.623835
Epoch 78
Validation auc = 0.635392
Epoch 79
Validation auc = 0.640626
Epoch 80
Loss = 4.0416e-01, PNorm = 72.6352, GNorm = 1.0718, lr_0 = 9.9802e-04
Validation auc = 0.652565
Epoch 81
Validation auc = 0.637736
Epoch 82
Validation auc = 0.648040
Epoch 83
Validation auc = 0.639645
Epoch 84
Loss = 4.1763e-01, PNorm = 73.2305, GNorm = 1.3324, lr_0 = 9.9779e-04
Loss = 4.1895e-01, PNorm = 73.2790, GNorm = 1.8315, lr_0 = 9.9777e-04
Validation auc = 0.644824
Epoch 85
Validation auc = 0.667775
Epoch 86
Validation auc = 0.674372
Epoch 87
Validation auc = 0.667721
Epoch 88
Validation auc = 0.676988
Epoch 89
Loss = 3.9878e-01, PNorm = 74.0165, GNorm = 1.7670, lr_0 = 9.9752e-04
Loss = 4.8295e-01, PNorm = 74.0686, GNorm = 4.0022, lr_0 = 9.9750e-04
Validation auc = 0.666194
Epoch 90
Validation auc = 0.648040
Epoch 91
Validation auc = 0.649130
Epoch 92
Validation auc = 0.628251
Epoch 93
Validation auc = 0.616638
Epoch 94
Loss = 4.7531e-01, PNorm = 74.7329, GNorm = 1.3917, lr_0 = 9.9727e-04
Validation auc = 0.625743
Epoch 95
Validation auc = 0.619364
Epoch 96
Validation auc = 0.623126
Epoch 97
Validation auc = 0.633321
Epoch 98
Validation auc = 0.611677
Epoch 99
Loss = 3.6323e-01, PNorm = 75.4361, GNorm = 0.7593, lr_0 = 9.9701e-04
Validation auc = 0.632884
Epoch 100
Validation auc = 0.660524
Epoch 101
Validation auc = 0.640844
Epoch 102
Validation auc = 0.622254
Epoch 103
Loss = 2.9548e-01, PNorm = 76.0595, GNorm = 1.7719, lr_0 = 9.9678e-04
Loss = 1.8405e-01, PNorm = 76.1089, GNorm = 2.1152, lr_0 = 9.9676e-04
Validation auc = 0.616202
Epoch 104
Validation auc = 0.612931
Epoch 105
Validation auc = 0.637191
Epoch 106
Validation auc = 0.643842
Epoch 107
Validation auc = 0.660252
Epoch 108
Loss = 2.7293e-01, PNorm = 76.9025, GNorm = 1.2411, lr_0 = 9.9651e-04
Validation auc = 0.682713
Epoch 109
Validation auc = 0.688982
Epoch 110
Validation auc = 0.680150
Epoch 111
Validation auc = 0.671537
Epoch 112
Validation auc = 0.659380
Epoch 113
Loss = 4.4919e-01, PNorm = 77.6170, GNorm = 5.5148, lr_0 = 9.9627e-04
Validation auc = 0.612604
Epoch 114
Validation auc = 0.646132
Epoch 115
Validation auc = 0.678679
Epoch 116
Validation auc = 0.655073
Epoch 117
Loss = 2.4767e-01, PNorm = 78.1997, GNorm = 1.0140, lr_0 = 9.9604e-04
Loss = 6.0065e-01, PNorm = 78.2490, GNorm = 3.1237, lr_0 = 9.9602e-04
Validation auc = 0.616093
Epoch 118
Validation auc = 0.620782
Epoch 119
Validation auc = 0.660361
Epoch 120
Validation auc = 0.649076
Epoch 121
Validation auc = 0.668375
Epoch 122
Loss = 3.7079e-01, PNorm = 78.8686, GNorm = 2.6154, lr_0 = 9.9577e-04
Loss = 7.9989e-01, PNorm = 78.9052, GNorm = 5.4261, lr_0 = 9.9575e-04
Validation auc = 0.663523
Epoch 123
Validation auc = 0.656981
Epoch 124
Validation auc = 0.674644
Epoch 125
Validation auc = 0.695034
Epoch 126
Validation auc = 0.696342
Epoch 127
Loss = 2.1688e-01, PNorm = 79.4491, GNorm = 0.8883, lr_0 = 9.9552e-04
Validation auc = 0.685439
Epoch 128
Validation auc = 0.686911
Epoch 129
Validation auc = 0.684730
Epoch 130
Validation auc = 0.668211
Epoch 131
Validation auc = 0.657362
Epoch 132
Loss = 7.4423e-02, PNorm = 79.9943, GNorm = 0.6587, lr_0 = 9.9526e-04
Validation auc = 0.645423
Epoch 133
Validation auc = 0.652783
Epoch 134
Validation auc = 0.662160
Epoch 135
Validation auc = 0.655291
Epoch 136
Loss = 1.1238e-01, PNorm = 80.4245, GNorm = 0.5472, lr_0 = 9.9503e-04
Loss = 2.3736e-02, PNorm = 80.4546, GNorm = 0.5716, lr_0 = 9.9501e-04
Validation auc = 0.658725
Epoch 137
Validation auc = 0.649567
Epoch 138
Validation auc = 0.640953
Epoch 139
Validation auc = 0.625579
Epoch 140
Validation auc = 0.630704
Epoch 141
Loss = 5.7190e-01, PNorm = 80.9950, GNorm = 3.8416, lr_0 = 9.9477e-04
Validation auc = 0.585237
Epoch 142
Validation auc = 0.622908
Epoch 143
Validation auc = 0.650439
Epoch 144
Validation auc = 0.665867
Epoch 145
Validation auc = 0.670283
Epoch 146
Loss = 1.9916e-01, PNorm = 81.7637, GNorm = 0.7598, lr_0 = 9.9452e-04
Validation auc = 0.656926
Epoch 147
Validation auc = 0.628741
Epoch 148
Validation auc = 0.618765
Epoch 149
Validation auc = 0.644878
Epoch 150
Loss = 1.3939e-01, PNorm = 82.2829, GNorm = 1.1584, lr_0 = 9.9429e-04
Loss = 3.4593e-02, PNorm = 82.3190, GNorm = 0.4149, lr_0 = 9.9427e-04
Validation auc = 0.645696
Epoch 151
Validation auc = 0.628959
Epoch 152
Validation auc = 0.624980
Epoch 153
Validation auc = 0.634138
Epoch 154
Validation auc = 0.637409
Epoch 155
Loss = 1.2321e-01, PNorm = 82.7247, GNorm = 0.5991, lr_0 = 9.9403e-04
Loss = 8.1616e-02, PNorm = 82.7469, GNorm = 1.7306, lr_0 = 9.9401e-04
Validation auc = 0.643951
Epoch 156
Validation auc = 0.658344
Epoch 157
Validation auc = 0.660252
Epoch 158
Validation auc = 0.625743
Epoch 159
Validation auc = 0.678624
Epoch 160
Loss = 2.2409e-02, PNorm = 83.0058, GNorm = 0.4273, lr_0 = 9.9378e-04
Validation auc = 0.691054
Epoch 161
Validation auc = 0.679115
Epoch 162
Validation auc = 0.655182
Epoch 163
Validation auc = 0.662433
Epoch 164
Validation auc = 0.659925
Epoch 165
Loss = 6.0177e-02, PNorm = 83.2949, GNorm = 0.4166, lr_0 = 9.9351e-04
Validation auc = 0.655945
Epoch 166
Validation auc = 0.645641
Epoch 167
Validation auc = 0.670446
Epoch 168
Validation auc = 0.688328
Epoch 169
Loss = 3.1344e-02, PNorm = 83.5132, GNorm = 0.4087, lr_0 = 9.9329e-04
Loss = 2.7323e-02, PNorm = 83.5282, GNorm = 0.4542, lr_0 = 9.9327e-04
Validation auc = 0.692417
Epoch 170
Validation auc = 0.690890
Epoch 171
Validation auc = 0.696560
Epoch 172
Validation auc = 0.699340
Epoch 173
Validation auc = 0.689309
Epoch 174
Loss = 2.4222e-02, PNorm = 83.7190, GNorm = 0.3963, lr_0 = 9.9302e-04
Validation auc = 0.672082
Epoch 175
Validation auc = 0.660197
Epoch 176
Validation auc = 0.649621
Epoch 177
Validation auc = 0.642098
Epoch 178
Validation auc = 0.638227
Epoch 179
Loss = 3.9169e-03, PNorm = 83.8693, GNorm = 0.0554, lr_0 = 9.9277e-04
Validation auc = 0.625743
Epoch 180
Validation auc = 0.657581
Epoch 181
Validation auc = 0.680968
Epoch 182
Validation auc = 0.693725
Epoch 183
Loss = 2.9557e-02, PNorm = 84.1048, GNorm = 0.3638, lr_0 = 9.9253e-04
Validation auc = 0.702993
Epoch 184
Validation auc = 0.690127
Epoch 185
Validation auc = 0.688437
Epoch 186
Validation auc = 0.709808
Epoch 187
Validation auc = 0.720438
Epoch 188
Loss = 6.4661e-02, PNorm = 84.3711, GNorm = 1.2400, lr_0 = 9.9228e-04
Loss = 5.4618e-02, PNorm = 84.3997, GNorm = 1.5335, lr_0 = 9.9226e-04
Validation auc = 0.718312
Epoch 189
Validation auc = 0.700431
Epoch 190
Validation auc = 0.684730
Epoch 191
Validation auc = 0.673990
Epoch 192
Validation auc = 0.662651
Epoch 193
Loss = 3.5096e-02, PNorm = 84.7286, GNorm = 0.5366, lr_0 = 9.9204e-04
Validation auc = 0.649021
Epoch 194
Validation auc = 0.639808
Epoch 195
Validation auc = 0.626179
Epoch 196
Validation auc = 0.638718
Epoch 197
Validation auc = 0.650984
Epoch 198
Loss = 4.1404e-02, PNorm = 85.0498, GNorm = 0.9577, lr_0 = 9.9177e-04
Validation auc = 0.668266
Epoch 199
Validation auc = 0.680150
Epoch 200
Validation auc = 0.687456
Epoch 201
Validation auc = 0.696287
Epoch 202
Loss = 8.7022e-02, PNorm = 85.2747, GNorm = 0.4701, lr_0 = 9.9154e-04
Loss = 1.7965e-02, PNorm = 85.2923, GNorm = 0.6670, lr_0 = 9.9153e-04
Validation auc = 0.700431
Epoch 203
Validation auc = 0.691163
Epoch 204
Validation auc = 0.687565
Epoch 205
Validation auc = 0.682604
Epoch 206
Validation auc = 0.679278
Epoch 207
Loss = 3.2519e-02, PNorm = 85.5230, GNorm = 0.0387, lr_0 = 9.9128e-04
Loss = 1.3362e-02, PNorm = 85.5384, GNorm = 0.5335, lr_0 = 9.9126e-04
Validation auc = 0.671428
Epoch 208
Validation auc = 0.666957
Epoch 209
Validation auc = 0.664777
Epoch 210
Validation auc = 0.671482
Epoch 211
Validation auc = 0.668266
Epoch 212
Loss = 1.0910e-01, PNorm = 85.7253, GNorm = 2.1139, lr_0 = 9.9103e-04
Validation auc = 0.644442
Epoch 213
Validation auc = 0.646841
Epoch 214
Validation auc = 0.672027
Epoch 215
Validation auc = 0.687292
Epoch 216
Loss = 4.5281e-01, PNorm = 86.2122, GNorm = 7.3361, lr_0 = 9.9079e-04
Validation auc = 0.683585
Epoch 217
Validation auc = 0.683858
Epoch 218
Validation auc = 0.681677
Epoch 219
Validation auc = 0.686529
Epoch 220
Validation auc = 0.692308
Epoch 221
Loss = 8.1623e-02, PNorm = 86.7779, GNorm = 2.0498, lr_0 = 9.9054e-04
Loss = 1.5378e-02, PNorm = 86.8107, GNorm = 0.7155, lr_0 = 9.9052e-04
Validation auc = 0.684239
Epoch 222
Validation auc = 0.691981
Epoch 223
Validation auc = 0.695688
Epoch 224
Validation auc = 0.683803
Epoch 225
Validation auc = 0.676552
Epoch 226
Loss = 1.0946e-01, PNorm = 87.1533, GNorm = 0.9544, lr_0 = 9.9030e-04
Validation auc = 0.670665
Epoch 227
Validation auc = 0.675626
Epoch 228
Validation auc = 0.670719
Epoch 229
Validation auc = 0.676389
Epoch 230
Validation auc = 0.689527
Epoch 231
Loss = 9.2860e-03, PNorm = 87.4086, GNorm = 0.1641, lr_0 = 9.9003e-04
Validation auc = 0.699886
Epoch 232
Validation auc = 0.698523
Epoch 233
Validation auc = 0.692744
Epoch 234
Validation auc = 0.679823
Epoch 235
Loss = 1.1568e-01, PNorm = 87.5764, GNorm = 5.9523, lr_0 = 9.8980e-04
Loss = 2.5199e-02, PNorm = 87.5953, GNorm = 0.8113, lr_0 = 9.8979e-04
Validation auc = 0.664613
Epoch 236
Validation auc = 0.645532
Epoch 237
Validation auc = 0.638282
Epoch 238
Validation auc = 0.648912
Epoch 239
Validation auc = 0.661233
Epoch 240
Loss = 4.9837e-02, PNorm = 87.9336, GNorm = 0.6147, lr_0 = 9.8954e-04
Loss = 5.9841e-03, PNorm = 87.9561, GNorm = 0.1542, lr_0 = 9.8952e-04
Validation auc = 0.667993
Epoch 241
Validation auc = 0.663141
Epoch 242
Validation auc = 0.657362
Epoch 243
Validation auc = 0.658344
Epoch 244
Validation auc = 0.646405
Epoch 245
Loss = 3.2205e-02, PNorm = 88.2647, GNorm = 0.5866, lr_0 = 9.8930e-04
Validation auc = 0.622799
Epoch 246
Validation auc = 0.621436
Epoch 247
Validation auc = 0.629832
Epoch 248
Validation auc = 0.633920
Epoch 249
Loss = 2.6151e-02, PNorm = 88.6521, GNorm = 0.0539, lr_0 = 9.8905e-04
Validation auc = 0.641716
Epoch 250
Validation auc = 0.661124
Epoch 251
Validation auc = 0.661124
Epoch 252
Validation auc = 0.658126
Epoch 253
Validation auc = 0.652183
Epoch 254
Loss = 5.3521e-02, PNorm = 88.9992, GNorm = 0.3904, lr_0 = 9.8880e-04
Loss = 1.8236e-01, PNorm = 89.0402, GNorm = 7.9601, lr_0 = 9.8879e-04
Validation auc = 0.647386
Epoch 255
Validation auc = 0.627651
Epoch 256
Validation auc = 0.645641
Epoch 257
Validation auc = 0.635937
Epoch 258
Validation auc = 0.658725
Epoch 259
Loss = 1.6901e-01, PNorm = 89.7157, GNorm = 1.1171, lr_0 = 9.8856e-04
Validation auc = 0.671373
Epoch 260
Validation auc = 0.673172
Epoch 261
Validation auc = 0.667939
Epoch 262
Validation auc = 0.662705
Epoch 263
Validation auc = 0.643897
Epoch 264
Loss = 2.3887e-02, PNorm = 90.5678, GNorm = 0.3592, lr_0 = 9.8830e-04
Validation auc = 0.632339
Epoch 265
Validation auc = 0.626179
Epoch 266
Validation auc = 0.629777
Epoch 267
Validation auc = 0.645205
Epoch 268
Loss = 1.6863e-01, PNorm = 90.9743, GNorm = 0.6338, lr_0 = 9.8807e-04
Loss = 1.4931e-02, PNorm = 90.9991, GNorm = 0.4211, lr_0 = 9.8805e-04
Validation auc = 0.662869
Epoch 269
Validation auc = 0.661942
Epoch 270
Validation auc = 0.660306
Epoch 271
Validation auc = 0.668429
Epoch 272
Validation auc = 0.669084
Epoch 273
Loss = 3.9934e-02, PNorm = 91.2672, GNorm = 0.3838, lr_0 = 9.8781e-04
Loss = 1.1768e-02, PNorm = 91.2817, GNorm = 0.3874, lr_0 = 9.8779e-04
Validation auc = 0.660306
Epoch 274
Validation auc = 0.652838
Epoch 275
Validation auc = 0.643570
Epoch 276
Validation auc = 0.638881
Epoch 277
Validation auc = 0.638990
Epoch 278
Loss = 1.5947e-01, PNorm = 91.4447, GNorm = 0.8150, lr_0 = 9.8756e-04
Validation auc = 0.643297
Epoch 279
Validation auc = 0.647986
Epoch 280
Validation auc = 0.626342
Epoch 281
Validation auc = 0.600992
Epoch 282
Validation auc = 0.593251
Epoch 283
Loss = 4.1603e-02, PNorm = 91.7135, GNorm = 0.5740, lr_0 = 9.8730e-04
Validation auc = 0.592051
Epoch 284
Validation auc = 0.604045
Epoch 285
Validation auc = 0.618874
Epoch 286
Validation auc = 0.639536
Epoch 287
Loss = 4.5041e-02, PNorm = 91.9612, GNorm = 0.9147, lr_0 = 9.8707e-04
Loss = 3.2224e-02, PNorm = 91.9805, GNorm = 1.1177, lr_0 = 9.8705e-04
Validation auc = 0.658671
Epoch 288
Validation auc = 0.665758
Epoch 289
Validation auc = 0.659925
Epoch 290
Validation auc = 0.659380
Epoch 291
Validation auc = 0.653492
Epoch 292
Loss = 5.3615e-02, PNorm = 92.1935, GNorm = 0.9316, lr_0 = 9.8683e-04
Validation auc = 0.662378
Epoch 293
Validation auc = 0.669084
Epoch 294
Validation auc = 0.674753
Epoch 295
Validation auc = 0.679006
Epoch 296
Validation auc = 0.684130
Epoch 297
Loss = 1.1754e-02, PNorm = 92.3396, GNorm = 0.3009, lr_0 = 9.8656e-04
Validation auc = 0.691217
Epoch 298
Validation auc = 0.693453
Epoch 299
Validation auc = 0.689418
Epoch 300
Validation auc = 0.700594
Epoch 301
Loss = 8.1513e-02, PNorm = 92.4672, GNorm = 0.6673, lr_0 = 9.8634e-04
Loss = 6.2238e-02, PNorm = 92.4735, GNorm = 2.9270, lr_0 = 9.8632e-04
Validation auc = 0.695742
Epoch 302
Validation auc = 0.679060
Epoch 303
Validation auc = 0.669956
Epoch 304
Validation auc = 0.667175
Epoch 305
Validation auc = 0.675189
Epoch 306
Loss = 1.3054e-01, PNorm = 92.6270, GNorm = 3.0733, lr_0 = 9.8607e-04
Loss = 5.0618e-02, PNorm = 92.6460, GNorm = 1.1614, lr_0 = 9.8606e-04
Validation auc = 0.705773
Epoch 307
Validation auc = 0.713297
Epoch 308
Validation auc = 0.709099
Epoch 309
Validation auc = 0.710625
Epoch 310
Validation auc = 0.703756
Epoch 311
Loss = 9.6955e-02, PNorm = 92.9414, GNorm = 0.7294, lr_0 = 9.8583e-04
Validation auc = 0.692798
Epoch 312
Validation auc = 0.694379
Epoch 313
Validation auc = 0.688819
Epoch 314
Validation auc = 0.685111
Epoch 315
Validation auc = 0.677915
Epoch 316
Loss = 7.7376e-02, PNorm = 93.1988, GNorm = 0.6817, lr_0 = 9.8557e-04
Validation auc = 0.673009
Epoch 317
Validation auc = 0.663141
Epoch 318
Validation auc = 0.648149
Epoch 319
Validation auc = 0.638718
Epoch 320
Loss = 1.6497e-02, PNorm = 93.3312, GNorm = 0.3756, lr_0 = 9.8534e-04
Loss = 3.4342e-03, PNorm = 93.3383, GNorm = 0.0864, lr_0 = 9.8532e-04
Validation auc = 0.636973
Epoch 321
Validation auc = 0.645314
Epoch 322
Validation auc = 0.654091
Epoch 323
Validation auc = 0.659489
Epoch 324
Validation auc = 0.656436
Epoch 325
Loss = 1.1994e-02, PNorm = 93.4167, GNorm = 0.1690, lr_0 = 9.8509e-04
Validation auc = 0.654473
Epoch 326
Validation auc = 0.657362
Epoch 327
Validation auc = 0.687292
Epoch 328
Validation auc = 0.693398
Epoch 329
Validation auc = 0.695633
Epoch 330
Loss = 4.4208e-02, PNorm = 93.5139, GNorm = 1.0383, lr_0 = 9.8483e-04
Validation auc = 0.701630
Epoch 331
Validation auc = 0.703266
Epoch 332
Validation auc = 0.701357
Epoch 333
Validation auc = 0.700812
Epoch 334
Loss = 1.0208e-01, PNorm = 93.6460, GNorm = 2.0622, lr_0 = 9.8461e-04
Loss = 8.4856e-02, PNorm = 93.6587, GNorm = 3.1863, lr_0 = 9.8459e-04
Validation auc = 0.690781
Epoch 335
Validation auc = 0.672409
Epoch 336
Validation auc = 0.667775
Epoch 337
Validation auc = 0.674862
Epoch 338
Validation auc = 0.691326
Epoch 339
Loss = 1.3432e-01, PNorm = 93.8506, GNorm = 2.1106, lr_0 = 9.8434e-04
Loss = 4.1575e-01, PNorm = 93.8756, GNorm = 10.2432, lr_0 = 9.8433e-04
Validation auc = 0.690073
Epoch 340
Validation auc = 0.669792
Epoch 341
Validation auc = 0.648313
Epoch 342
Validation auc = 0.596576
Epoch 343
Validation auc = 0.607098
Epoch 344
Loss = 3.7456e-02, PNorm = 94.4589, GNorm = 0.6154, lr_0 = 9.8410e-04
Validation auc = 0.615221
Epoch 345
Validation auc = 0.618274
Epoch 346
Validation auc = 0.643515
Epoch 347
Validation auc = 0.656708
Epoch 348
Validation auc = 0.652292
Epoch 349
Loss = 1.2253e-02, PNorm = 94.9249, GNorm = 0.1368, lr_0 = 9.8384e-04
Validation auc = 0.653873
Epoch 350
Validation auc = 0.660143
Epoch 351
Validation auc = 0.662923
Epoch 352
Validation auc = 0.665158
Epoch 353
Loss = 5.4235e-02, PNorm = 95.1612, GNorm = 0.8184, lr_0 = 9.8361e-04
Loss = 6.9441e-02, PNorm = 95.1719, GNorm = 2.6768, lr_0 = 9.8359e-04
Validation auc = 0.666412
Epoch 354
Validation auc = 0.661724
Epoch 355
Validation auc = 0.660906
Epoch 356
Validation auc = 0.657090
Epoch 357
Validation auc = 0.649403
Epoch 358
Loss = 2.9501e-02, PNorm = 95.3311, GNorm = 0.5630, lr_0 = 9.8335e-04
Validation auc = 0.647113
Epoch 359
Validation auc = 0.654964
Epoch 360
Validation auc = 0.672300
Epoch 361
Validation auc = 0.682495
Epoch 362
Validation auc = 0.685330
Epoch 363
Loss = 6.9713e-03, PNorm = 95.4989, GNorm = 0.1079, lr_0 = 9.8311e-04
Validation auc = 0.688546
Epoch 364
Validation auc = 0.689963
Epoch 365
Validation auc = 0.686365
Epoch 366
Validation auc = 0.687292
Epoch 367
Loss = 1.7225e-02, PNorm = 95.6034, GNorm = 0.7655, lr_0 = 9.8288e-04
Loss = 3.1260e-02, PNorm = 95.6103, GNorm = 1.3606, lr_0 = 9.8286e-04
Validation auc = 0.685766
Epoch 368
Validation auc = 0.684130
Epoch 369
Validation auc = 0.684076
Epoch 370
Validation auc = 0.679006
Epoch 371
Validation auc = 0.673990
Epoch 372
Loss = 1.0768e-01, PNorm = 95.7047, GNorm = 0.0786, lr_0 = 9.8262e-04
Loss = 7.1761e-04, PNorm = 95.7111, GNorm = 0.0235, lr_0 = 9.8260e-04
Validation auc = 0.671755
Epoch 373
Validation auc = 0.674590
Epoch 374
Validation auc = 0.675953
Epoch 375
Validation auc = 0.678406
Epoch 376
Validation auc = 0.683967
Epoch 377
Loss = 3.3363e-03, PNorm = 95.7836, GNorm = 0.0465, lr_0 = 9.8237e-04
Validation auc = 0.686747
Epoch 378
Validation auc = 0.692090
Epoch 379
Validation auc = 0.698904
Epoch 380
Validation auc = 0.700594
Epoch 381
Validation auc = 0.693453
Epoch 382
Loss = 9.4589e-03, PNorm = 95.8728, GNorm = 0.1983, lr_0 = 9.8211e-04
Validation auc = 0.687183
Epoch 383
Validation auc = 0.682386
Epoch 384
Validation auc = 0.677152
Epoch 385
Validation auc = 0.671728
Epoch 386
Loss = 7.3615e-03, PNorm = 95.9641, GNorm = 0.2765, lr_0 = 9.8189e-04
Loss = 1.7618e-03, PNorm = 95.9696, GNorm = 0.0615, lr_0 = 9.8187e-04
Validation auc = 0.668920
Epoch 387
Validation auc = 0.667421
Epoch 388
Validation auc = 0.668457
Epoch 389
Validation auc = 0.670992
Epoch 390
Validation auc = 0.671155
Epoch 391
Loss = 5.3752e-03, PNorm = 96.0265, GNorm = 0.0984, lr_0 = 9.8163e-04
Validation auc = 0.669683
Epoch 392
Validation auc = 0.670692
Epoch 393
Validation auc = 0.671155
Epoch 394
Validation auc = 0.667503
Epoch 395
Validation auc = 0.658507
Epoch 396
Loss = 4.5188e-03, PNorm = 96.0666, GNorm = 0.0843, lr_0 = 9.8138e-04
Validation auc = 0.656054
Epoch 397
Validation auc = 0.654528
Epoch 398
Validation auc = 0.653056
Epoch 399
Validation auc = 0.649894
Epoch 400
Loss = 2.4826e-03, PNorm = 96.1154, GNorm = 0.0345, lr_0 = 9.8116e-04
Loss = 3.6452e-03, PNorm = 96.1185, GNorm = 0.1236, lr_0 = 9.8114e-04
Validation auc = 0.648040
Epoch 401
Validation auc = 0.644987
Epoch 402
Validation auc = 0.646296
Epoch 403
Validation auc = 0.647549
Epoch 404
Validation auc = 0.651638
Epoch 405
Loss = 2.8757e-02, PNorm = 96.1823, GNorm = 0.3302, lr_0 = 9.8089e-04
Loss = 1.2052e-02, PNorm = 96.1886, GNorm = 0.3140, lr_0 = 9.8088e-04
Validation auc = 0.653601
Epoch 406
Validation auc = 0.656327
Epoch 407
Validation auc = 0.662651
Epoch 408
Validation auc = 0.663959
Epoch 409
Validation auc = 0.655618
Epoch 410
Loss = 1.2599e-03, PNorm = 96.3011, GNorm = 0.0328, lr_0 = 9.8065e-04
Validation auc = 0.644388
Epoch 411
Validation auc = 0.651475
Epoch 412
Validation auc = 0.658780
Epoch 413
Validation auc = 0.662705
Epoch 414
Validation auc = 0.659107
Epoch 415
Loss = 3.2919e-03, PNorm = 96.4679, GNorm = 0.0638, lr_0 = 9.8039e-04
Validation auc = 0.659162
Epoch 416
Validation auc = 0.660415
Epoch 417
Validation auc = 0.663468
Epoch 418
Validation auc = 0.668157
Epoch 419
Loss = 1.1905e-01, PNorm = 96.5888, GNorm = 2.5277, lr_0 = 9.8016e-04
Loss = 1.5682e-03, PNorm = 96.6011, GNorm = 0.0554, lr_0 = 9.8015e-04
Validation auc = 0.661942
Epoch 420
Validation auc = 0.651148
Epoch 421
Validation auc = 0.646459
Epoch 422
Validation auc = 0.646078
Epoch 423
Validation auc = 0.643788
Epoch 424
Loss = 1.4995e-02, PNorm = 96.7462, GNorm = 0.3828, lr_0 = 9.7990e-04
Validation auc = 0.642479
Epoch 425
Validation auc = 0.637900
Epoch 426
Validation auc = 0.631903
Epoch 427
Validation auc = 0.627814
Epoch 428
Validation auc = 0.625634
Epoch 429
Loss = 1.3978e-02, PNorm = 96.8470, GNorm = 0.4443, lr_0 = 9.7966e-04
Validation auc = 0.623344
Epoch 430
Validation auc = 0.625252
Epoch 431
Validation auc = 0.628959
Epoch 432
Validation auc = 0.634465
Epoch 433
Loss = 6.4782e-04, PNorm = 97.0049, GNorm = 0.0088, lr_0 = 9.7942e-04
Validation auc = 0.637409
Epoch 434
Validation auc = 0.639863
Epoch 435
Validation auc = 0.642588
Epoch 436
Validation auc = 0.639645
Epoch 437
Validation auc = 0.644933
Epoch 438
Loss = 1.5780e-01, PNorm = 97.2865, GNorm = 1.9672, lr_0 = 9.7917e-04
Loss = 2.4902e-01, PNorm = 97.3412, GNorm = 11.5228, lr_0 = 9.7916e-04
Validation auc = 0.654419
Epoch 439
Validation auc = 0.640244
Epoch 440
Validation auc = 0.605463
Epoch 441
Validation auc = 0.672355
Epoch 442
Validation auc = 0.676552
Epoch 443
Loss = 1.3848e-01, PNorm = 98.2096, GNorm = 1.5899, lr_0 = 9.7893e-04
Validation auc = 0.657308
Epoch 444
Validation auc = 0.650711
Epoch 445
Validation auc = 0.641825
Epoch 446
Validation auc = 0.638663
Epoch 447
Validation auc = 0.638118
Epoch 448
Loss = 5.5973e-02, PNorm = 99.4624, GNorm = 0.5001, lr_0 = 9.7867e-04
Validation auc = 0.643352
Epoch 449
Validation auc = 0.641226
Epoch 450
Validation auc = 0.642970
Epoch 451
Validation auc = 0.648422
Epoch 452
Loss = 6.5294e-02, PNorm = 100.1724, GNorm = 1.8001, lr_0 = 9.7845e-04
Loss = 4.2105e-03, PNorm = 100.2089, GNorm = 0.1008, lr_0 = 9.7843e-04
Validation auc = 0.647549
Epoch 453
Validation auc = 0.646568
Epoch 454
Validation auc = 0.646132
Epoch 455
Validation auc = 0.666630
Epoch 456
Validation auc = 0.673227
Epoch 457
Loss = 1.1881e-01, PNorm = 100.6208, GNorm = 1.4193, lr_0 = 9.7819e-04
Loss = 2.2072e-02, PNorm = 100.6485, GNorm = 0.3722, lr_0 = 9.7817e-04
Validation auc = 0.663741
Epoch 458
Validation auc = 0.655945
Epoch 459
Validation auc = 0.650875
Epoch 460
Validation auc = 0.642534
Epoch 461
Validation auc = 0.653764
Epoch 462
Loss = 6.7393e-02, PNorm = 100.9824, GNorm = 0.8555, lr_0 = 9.7794e-04
Validation auc = 0.661015
Epoch 463
Validation auc = 0.663196
Epoch 464
Validation auc = 0.673499
Epoch 465
Validation auc = 0.682168
Epoch 466
Loss = 1.3457e-02, PNorm = 101.2610, GNorm = 0.1081, lr_0 = 9.7770e-04
Validation auc = 0.688164
Epoch 467
Validation auc = 0.691763
Epoch 468
Validation auc = 0.699068
Epoch 469
Validation auc = 0.714441
Epoch 470
Validation auc = 0.706809
Epoch 471
Loss = 1.1430e-02, PNorm = 101.4411, GNorm = 0.2270, lr_0 = 9.7746e-04
Loss = 1.2699e-02, PNorm = 101.4567, GNorm = 0.4477, lr_0 = 9.7744e-04
Validation auc = 0.700213
Epoch 472
Validation auc = 0.696833
Epoch 473
Validation auc = 0.688001
Epoch 474
Validation auc = 0.683094
Epoch 475
Validation auc = 0.677370
Epoch 476
Loss = 2.2229e-02, PNorm = 101.6379, GNorm = 0.6174, lr_0 = 9.7721e-04
Validation auc = 0.680750
Epoch 477
Validation auc = 0.680641
Epoch 478
Validation auc = 0.680423
Epoch 479
Validation auc = 0.683858
Epoch 480
Validation auc = 0.689854
Epoch 481
Loss = 5.1501e-02, PNorm = 101.8167, GNorm = 1.0649, lr_0 = 9.7695e-04
Validation auc = 0.688437
Epoch 482
Validation auc = 0.686147
Epoch 483
Validation auc = 0.684239
Epoch 484
Validation auc = 0.675789
Epoch 485
Loss = 5.0626e-03, PNorm = 101.9282, GNorm = 0.0628, lr_0 = 9.7673e-04
Loss = 1.4934e-02, PNorm = 101.9380, GNorm = 0.7064, lr_0 = 9.7671e-04
Validation auc = 0.670446
Epoch 486
Validation auc = 0.666957
Epoch 487
Validation auc = 0.664123
Epoch 488
Validation auc = 0.660361
Epoch 489
Validation auc = 0.658998
Epoch 490
Loss = 8.2420e-03, PNorm = 102.0396, GNorm = 0.1130, lr_0 = 9.7647e-04
Loss = 5.3392e-04, PNorm = 102.0443, GNorm = 0.0172, lr_0 = 9.7645e-04
Validation auc = 0.659162
Epoch 491
Validation auc = 0.658398
Epoch 492
Validation auc = 0.657035
Epoch 493
Validation auc = 0.655836
Epoch 494
Validation auc = 0.655672
Epoch 495
Loss = 5.2562e-03, PNorm = 102.0899, GNorm = 0.0911, lr_0 = 9.7623e-04
Validation auc = 0.656054
Epoch 496
Validation auc = 0.656545
Epoch 497
Validation auc = 0.656272
Epoch 498
Validation auc = 0.659598
Epoch 499
Loss = 7.2674e-02, PNorm = 102.1573, GNorm = 0.9486, lr_0 = 9.7599e-04
Validation auc = 0.656490
Epoch 500
Validation auc = 0.660034
Epoch 501
Validation auc = 0.664232
Epoch 502
Validation auc = 0.668102
Epoch 503
Validation auc = 0.668866
Epoch 504
Loss = 8.0112e-02, PNorm = 102.2323, GNorm = 3.2769, lr_0 = 9.7574e-04
Loss = 2.3334e-03, PNorm = 102.2432, GNorm = 0.0739, lr_0 = 9.7573e-04
Validation auc = 0.681459
Epoch 505
Validation auc = 0.677588
Epoch 506
Validation auc = 0.665758
Epoch 507
Validation auc = 0.660197
Epoch 508
Validation auc = 0.656490
Epoch 509
Loss = 1.3046e-03, PNorm = 102.3967, GNorm = 0.0277, lr_0 = 9.7550e-04
Validation auc = 0.654691
Epoch 510
Validation auc = 0.668266
Epoch 511
Validation auc = 0.666685
Epoch 512
Validation auc = 0.662269
Epoch 513
Validation auc = 0.644878
Epoch 514
Loss = 4.3807e-03, PNorm = 102.5001, GNorm = 0.1963, lr_0 = 9.7524e-04
Validation auc = 0.633103
Epoch 515
Validation auc = 0.622690
Epoch 516
Validation auc = 0.615766
Epoch 517
Validation auc = 0.613204
Epoch 518
Loss = 1.0678e-02, PNorm = 102.5916, GNorm = 0.1276, lr_0 = 9.7502e-04
Loss = 2.4990e-03, PNorm = 102.5966, GNorm = 0.0789, lr_0 = 9.7500e-04
Validation auc = 0.613313
Epoch 519
Validation auc = 0.613149
Epoch 520
Validation auc = 0.607044
Epoch 521
Validation auc = 0.599466
Epoch 522
Validation auc = 0.608352
Epoch 523
Loss = 1.2611e-02, PNorm = 102.6540, GNorm = 0.3791, lr_0 = 9.7476e-04
Loss = 2.7053e-03, PNorm = 102.6596, GNorm = 0.0797, lr_0 = 9.7474e-04
Validation auc = 0.617674
Epoch 524
Validation auc = 0.627051
Epoch 525
Validation auc = 0.634084
Epoch 526
Validation auc = 0.640517
Epoch 527
Validation auc = 0.646132
Epoch 528
Loss = 2.1190e-03, PNorm = 102.7204, GNorm = 0.0428, lr_0 = 9.7452e-04
Validation auc = 0.649076
Epoch 529
Validation auc = 0.648967
Epoch 530
Validation auc = 0.644933
Epoch 531
Validation auc = 0.635065
Epoch 532
Validation auc = 0.637355
Epoch 533
Loss = 6.3981e-03, PNorm = 102.8462, GNorm = 0.1319, lr_0 = 9.7426e-04
Validation auc = 0.630268
Epoch 534
Validation auc = 0.625307
Epoch 535
Validation auc = 0.623780
Epoch 536
Validation auc = 0.624107
Epoch 537
Loss = 4.8938e-02, PNorm = 103.0032, GNorm = 0.6815, lr_0 = 9.7403e-04
Loss = 4.6591e-02, PNorm = 103.0231, GNorm = 0.9807, lr_0 = 9.7401e-04
Validation auc = 0.622145
Epoch 538
Validation auc = 0.624980
Epoch 539
Validation auc = 0.630704
Epoch 540
Validation auc = 0.636374
Epoch 541
Validation auc = 0.637028
Epoch 542
Loss = 2.1640e-03, PNorm = 103.2238, GNorm = 0.0355, lr_0 = 9.7379e-04
Validation auc = 0.637682
Epoch 543
Validation auc = 0.640135
Epoch 544
Validation auc = 0.642152
Epoch 545
Validation auc = 0.643897
Epoch 546
Validation auc = 0.646841
Epoch 547
Loss = 1.6314e-02, PNorm = 103.3341, GNorm = 0.3587, lr_0 = 9.7353e-04
Validation auc = 0.649239
Epoch 548
Validation auc = 0.652838
Epoch 549
Validation auc = 0.656926
Epoch 550
Validation auc = 0.660306
Epoch 551
Loss = 7.5485e-02, PNorm = 103.3783, GNorm = 0.4500, lr_0 = 9.7331e-04
Loss = 3.8346e-03, PNorm = 103.3811, GNorm = 0.0970, lr_0 = 9.7329e-04
Validation auc = 0.657308
Epoch 552
Validation auc = 0.653437
Epoch 553
Validation auc = 0.652401
Epoch 554
Validation auc = 0.651202
Epoch 555
Validation auc = 0.649894
Epoch 556
Loss = 4.7475e-03, PNorm = 103.4219, GNorm = 0.0908, lr_0 = 9.7305e-04
Loss = 4.1336e-04, PNorm = 103.4243, GNorm = 0.0118, lr_0 = 9.7303e-04
Validation auc = 0.649458
Epoch 557
Validation auc = 0.648858
Epoch 558
Validation auc = 0.650330
Epoch 559
Validation auc = 0.650984
Epoch 560
Validation auc = 0.653110
Epoch 561
Loss = 1.0566e-02, PNorm = 103.4550, GNorm = 0.2217, lr_0 = 9.7281e-04
Validation auc = 0.654310
Epoch 562
Validation auc = 0.655454
Epoch 563
Validation auc = 0.657581
Epoch 564
Validation auc = 0.660361
Epoch 565
Validation auc = 0.663523
Epoch 566
Loss = 1.3028e-03, PNorm = 103.4913, GNorm = 0.0214, lr_0 = 9.7255e-04
Validation auc = 0.672573
Epoch 567
Validation auc = 0.651475
Epoch 568
Validation auc = 0.603445
Epoch 569
Validation auc = 0.608406
Epoch 570
Loss = 1.6701e-01, PNorm = 103.7873, GNorm = 2.8272, lr_0 = 9.7232e-04
Loss = 1.8036e-02, PNorm = 103.8247, GNorm = 0.3889, lr_0 = 9.7231e-04
Validation auc = 0.569536
Epoch 571
Validation auc = 0.586109
Epoch 572
Validation auc = 0.592270
Epoch 573
Validation auc = 0.605681
Epoch 574
Validation auc = 0.594450
Epoch 575
Loss = 1.0167e-01, PNorm = 104.2589, GNorm = 0.7054, lr_0 = 9.7208e-04
Validation auc = 0.594505
Epoch 576
Validation auc = 0.624380
Epoch 577
Validation auc = 0.633048
Epoch 578
Validation auc = 0.633648
Epoch 579
Validation auc = 0.632503
Epoch 580
Loss = 1.8829e-02, PNorm = 104.5653, GNorm = 0.3386, lr_0 = 9.7182e-04
Validation auc = 0.631631
Epoch 581
Validation auc = 0.632775
Epoch 582
Validation auc = 0.622690
Epoch 583
Validation auc = 0.603173
Epoch 584
Loss = 3.7468e-02, PNorm = 104.7937, GNorm = 0.8593, lr_0 = 9.7160e-04
Loss = 2.7927e-02, PNorm = 104.8128, GNorm = 1.0962, lr_0 = 9.7158e-04
Validation auc = 0.601156
Epoch 585
Validation auc = 0.613149
Epoch 586
Validation auc = 0.625688
Epoch 587
Validation auc = 0.633975
Epoch 588
Validation auc = 0.635719
Epoch 589
Loss = 9.7009e-02, PNorm = 105.1425, GNorm = 1.6824, lr_0 = 9.7134e-04
Loss = 1.9186e-03, PNorm = 105.1618, GNorm = 0.0422, lr_0 = 9.7132e-04
Validation auc = 0.631031
Epoch 590
Validation auc = 0.624216
Epoch 591
Validation auc = 0.612495
Epoch 592
Validation auc = 0.577877
Epoch 593
Validation auc = 0.624871
Epoch 594
Loss = 1.5549e-02, PNorm = 105.4149, GNorm = 0.1761, lr_0 = 9.7110e-04
Validation auc = 0.654582
Epoch 595
Validation auc = 0.667339
Epoch 596
Validation auc = 0.654473
Epoch 597
Validation auc = 0.633920
Epoch 598
Validation auc = 0.640517
Epoch 599
Loss = 1.3860e-02, PNorm = 105.7582, GNorm = 0.1305, lr_0 = 9.7084e-04
Validation auc = 0.642752
Epoch 600
Validation auc = 0.640953
Epoch 601
Validation auc = 0.631685
Epoch 602
Validation auc = 0.616857
Epoch 603
Loss = 8.2838e-02, PNorm = 106.1051, GNorm = 0.9489, lr_0 = 9.7062e-04
Loss = 4.4434e-02, PNorm = 106.1257, GNorm = 1.0630, lr_0 = 9.7060e-04
Validation auc = 0.617838
Epoch 604
Validation auc = 0.625143
Epoch 605
Validation auc = 0.628741
Epoch 606
Validation auc = 0.634847
Epoch 607
Validation auc = 0.639263
Epoch 608
Loss = 2.6453e-02, PNorm = 106.3880, GNorm = 0.5889, lr_0 = 9.7036e-04
Validation auc = 0.639917
Epoch 609
Validation auc = 0.638990
Epoch 610
Validation auc = 0.636374
Epoch 611
Validation auc = 0.637682
Epoch 612
Validation auc = 0.633648
Epoch 613
Loss = 1.3224e-02, PNorm = 106.5360, GNorm = 0.4177, lr_0 = 9.7012e-04
Validation auc = 0.624925
Epoch 614
Validation auc = 0.621381
Epoch 615
Validation auc = 0.624434
Epoch 616
Validation auc = 0.629014
Epoch 617
Loss = 3.3480e-02, PNorm = 106.6510, GNorm = 0.1526, lr_0 = 9.6990e-04
Loss = 2.2978e-03, PNorm = 106.6566, GNorm = 0.0566, lr_0 = 9.6988e-04
Validation auc = 0.633648
Epoch 618
Validation auc = 0.638118
Epoch 619
Validation auc = 0.641989
Epoch 620
Validation auc = 0.645260
Epoch 621
Validation auc = 0.646514
Epoch 622
Loss = 5.2373e-02, PNorm = 106.7230, GNorm = 0.5656, lr_0 = 9.6964e-04
Loss = 8.4054e-02, PNorm = 106.7266, GNorm = 3.3256, lr_0 = 9.6962e-04
Validation auc = 0.649730
Epoch 623
Validation auc = 0.657799
Epoch 624
Validation auc = 0.661179
Epoch 625
Validation auc = 0.659271
Epoch 626
Validation auc = 0.658616
Epoch 627
Loss = 7.5472e-03, PNorm = 106.7989, GNorm = 0.3336, lr_0 = 9.6940e-04
Validation auc = 0.654637
Epoch 628
Validation auc = 0.652074
Epoch 629
Validation auc = 0.649185
Epoch 630
Validation auc = 0.647113
Epoch 631
Validation auc = 0.646514
Epoch 632
Loss = 1.8950e-02, PNorm = 106.8639, GNorm = 0.5055, lr_0 = 9.6914e-04
Validation auc = 0.648258
Epoch 633
Validation auc = 0.648585
Epoch 634
Validation auc = 0.650384
Epoch 635
Validation auc = 0.651965
Epoch 636
Loss = 3.4468e-02, PNorm = 106.9055, GNorm = 1.1718, lr_0 = 9.6892e-04
Loss = 1.8605e-02, PNorm = 106.9087, GNorm = 1.0744, lr_0 = 9.6890e-04
Validation auc = 0.652838
Epoch 637
Validation auc = 0.649839
Epoch 638
Validation auc = 0.647168
Epoch 639
Validation auc = 0.644878
Epoch 640
Validation auc = 0.640571
Epoch 641
Loss = 4.3763e-03, PNorm = 106.9610, GNorm = 0.0567, lr_0 = 9.6866e-04
Validation auc = 0.633048
Epoch 642
Validation auc = 0.629504
Epoch 643
Validation auc = 0.629613
Epoch 644
Validation auc = 0.629668
Epoch 645
Validation auc = 0.630322
Epoch 646
Loss = 5.1743e-03, PNorm = 107.0385, GNorm = 0.0840, lr_0 = 9.6842e-04
Validation auc = 0.630758
Epoch 647
Validation auc = 0.631303
Epoch 648
Validation auc = 0.632394
Epoch 649
Validation auc = 0.635774
Epoch 650
Loss = 2.3913e-02, PNorm = 107.1013, GNorm = 0.5375, lr_0 = 9.6820e-04
Loss = 2.2801e-04, PNorm = 107.1098, GNorm = 0.0050, lr_0 = 9.6818e-04
Validation auc = 0.628142
Epoch 651
Validation auc = 0.626506
Epoch 652
Validation auc = 0.625361
Epoch 653
Validation auc = 0.625634
Epoch 654
Validation auc = 0.626179
Epoch 655
Loss = 2.3074e-03, PNorm = 107.2141, GNorm = 0.0279, lr_0 = 9.6794e-04
Loss = 8.4476e-03, PNorm = 107.2193, GNorm = 0.2289, lr_0 = 9.6792e-04
Validation auc = 0.627215
Epoch 656
Validation auc = 0.631576
Epoch 657
Validation auc = 0.633975
Epoch 658
Validation auc = 0.635665
Epoch 659
Validation auc = 0.638227
Epoch 660
Loss = 2.1255e-03, PNorm = 107.2734, GNorm = 0.0307, lr_0 = 9.6770e-04
Validation auc = 0.639917
Epoch 661
Validation auc = 0.639536
Epoch 662
Validation auc = 0.638663
Epoch 663
Validation auc = 0.627814
Epoch 664
Validation auc = 0.604100
Epoch 665
Loss = 6.5802e-03, PNorm = 107.3964, GNorm = 0.1519, lr_0 = 9.6744e-04
Validation auc = 0.589217
Epoch 666
Validation auc = 0.576950
Epoch 667
Validation auc = 0.576187
Epoch 668
Validation auc = 0.575042
Epoch 669
Loss = 9.4379e-02, PNorm = 107.6547, GNorm = 0.9434, lr_0 = 9.6722e-04
Loss = 6.0356e-03, PNorm = 107.6689, GNorm = 0.2027, lr_0 = 9.6720e-04
Validation auc = 0.569427
Epoch 670
Validation auc = 0.568718
Epoch 671
Validation auc = 0.569209
Epoch 672
Validation auc = 0.571335
Epoch 673
Validation auc = 0.572480
Epoch 674
Loss = 1.7921e-02, PNorm = 107.8554, GNorm = 0.4236, lr_0 = 9.6696e-04
Validation auc = 0.575969
Epoch 675
Validation auc = 0.577386
Epoch 676
Validation auc = 0.579295
Epoch 677
Validation auc = 0.580603
Epoch 678
Validation auc = 0.582511
Epoch 679
Loss = 3.3365e-03, PNorm = 108.0249, GNorm = 0.0714, lr_0 = 9.6672e-04
Validation auc = 0.583819
Epoch 680
Validation auc = 0.585291
Epoch 681
Validation auc = 0.583874
Epoch 682
Validation auc = 0.586436
Epoch 683
Loss = 7.0537e-03, PNorm = 108.0999, GNorm = 0.0252, lr_0 = 9.6648e-04
Validation auc = 0.585291
Epoch 684
Validation auc = 0.586327
Epoch 685
Validation auc = 0.574606
Epoch 686
Validation auc = 0.574115
Epoch 687
Validation auc = 0.576678
Epoch 688
Loss = 2.8000e-03, PNorm = 108.1704, GNorm = 0.0319, lr_0 = 9.6624e-04
Loss = 1.0225e-02, PNorm = 108.1758, GNorm = 0.2494, lr_0 = 9.6622e-04
Validation auc = 0.576841
Epoch 689
Validation auc = 0.578531
Epoch 690
Validation auc = 0.582784
Epoch 691
Validation auc = 0.587036
Epoch 692
Validation auc = 0.590798
Epoch 693
Loss = 5.5069e-03, PNorm = 108.2252, GNorm = 0.2369, lr_0 = 9.6600e-04
Validation auc = 0.594396
Epoch 694
Validation auc = 0.596031
Epoch 695
Validation auc = 0.596794
Epoch 696
Validation auc = 0.600065
Epoch 697
Validation auc = 0.597776
Epoch 698
Loss = 2.0534e-03, PNorm = 108.2605, GNorm = 0.0444, lr_0 = 9.6574e-04
Validation auc = 0.595213
Epoch 699
Validation auc = 0.591179
Epoch 700
Validation auc = 0.588508
Epoch 701
Validation auc = 0.585673
Epoch 702
Loss = 6.3961e-03, PNorm = 108.2875, GNorm = 0.1309, lr_0 = 9.6552e-04
Loss = 9.1506e-04, PNorm = 108.2898, GNorm = 0.0230, lr_0 = 9.6550e-04
Validation auc = 0.582838
Epoch 703
Validation auc = 0.581584
Epoch 704
Validation auc = 0.581039
Epoch 705
Validation auc = 0.581966
Epoch 706
Validation auc = 0.582020
Epoch 707
Loss = 1.8077e-03, PNorm = 108.3159, GNorm = 0.0108, lr_0 = 9.6526e-04
Loss = 1.8157e-04, PNorm = 108.3173, GNorm = 0.0061, lr_0 = 9.6525e-04
Validation auc = 0.582947
Epoch 708
Validation auc = 0.583601
Epoch 709
Validation auc = 0.584419
Epoch 710
Validation auc = 0.584583
Epoch 711
Validation auc = 0.584746
Epoch 712
Loss = 3.9290e-03, PNorm = 108.3400, GNorm = 0.0891, lr_0 = 9.6502e-04
Validation auc = 0.586109
Epoch 713
Validation auc = 0.587799
Epoch 714
Validation auc = 0.588889
Epoch 715
Validation auc = 0.588235
Epoch 716
Loss = 1.4804e-03, PNorm = 108.3681, GNorm = 0.0007, lr_0 = 9.6479e-04
Validation auc = 0.587090
Epoch 717
Validation auc = 0.586709
Epoch 718
Validation auc = 0.583710
Epoch 719
Validation auc = 0.581039
Epoch 720
Validation auc = 0.583656
Epoch 721
Loss = 4.6702e-03, PNorm = 108.4228, GNorm = 0.2591, lr_0 = 9.6455e-04
Loss = 7.6219e-04, PNorm = 108.4283, GNorm = 0.0277, lr_0 = 9.6453e-04
Validation auc = 0.584637
Epoch 722
Validation auc = 0.584038
Epoch 723
Validation auc = 0.582675
Epoch 724
Validation auc = 0.581639
Epoch 725
Validation auc = 0.581639
Epoch 726
Loss = 9.4923e-03, PNorm = 108.4832, GNorm = 0.2065, lr_0 = 9.6431e-04
Validation auc = 0.583765
Epoch 727
Validation auc = 0.587963
Epoch 728
Validation auc = 0.590689
Epoch 729
Validation auc = 0.593578
Epoch 730
Validation auc = 0.593741
Epoch 731
Loss = 2.5142e-03, PNorm = 108.5337, GNorm = 0.0326, lr_0 = 9.6405e-04
Validation auc = 0.593632
Epoch 732
Validation auc = 0.594777
Epoch 733
Validation auc = 0.595159
Epoch 734
Validation auc = 0.594777
Epoch 735
Loss = 1.0916e-03, PNorm = 108.5682, GNorm = 0.0246, lr_0 = 9.6383e-04
Loss = 6.6329e-04, PNorm = 108.5701, GNorm = 0.0284, lr_0 = 9.6381e-04
Validation auc = 0.595159
Epoch 736
Validation auc = 0.594777
Epoch 737
Validation auc = 0.593796
Epoch 738
Validation auc = 0.593033
Epoch 739
Validation auc = 0.592324
Epoch 740
Loss = 1.4363e-03, PNorm = 108.5894, GNorm = 0.0511, lr_0 = 9.6357e-04
Loss = 1.6862e-04, PNorm = 108.5904, GNorm = 0.0049, lr_0 = 9.6355e-04
Validation auc = 0.592160
Epoch 741
Validation auc = 0.592488
Epoch 742
Validation auc = 0.592706
Epoch 743
Validation auc = 0.592597
Epoch 744
Validation auc = 0.592896
Epoch 745
Loss = 2.4030e-04, PNorm = 108.6006, GNorm = 0.0063, lr_0 = 9.6333e-04
Validation auc = 0.593033
Epoch 746
Validation auc = 0.593251
Epoch 747
Validation auc = 0.593142
Epoch 748
Validation auc = 0.593414
Epoch 749
Loss = 5.0313e-03, PNorm = 108.6056, GNorm = 0.3812, lr_0 = 9.6309e-04
Validation auc = 0.595486
Epoch 750
Validation auc = 0.598430
Epoch 751
Validation auc = 0.599575
Epoch 752
Validation auc = 0.601156
Epoch 753
Validation auc = 0.601864
Epoch 754
Loss = 1.1724e-03, PNorm = 108.6224, GNorm = 0.0282, lr_0 = 9.6285e-04
Loss = 2.5524e-04, PNorm = 108.6235, GNorm = 0.0100, lr_0 = 9.6284e-04
Validation auc = 0.602137
Epoch 755
Validation auc = 0.602083
Epoch 756
Validation auc = 0.600992
Epoch 757
Validation auc = 0.600556
Epoch 758
Validation auc = 0.600338
Epoch 759
Loss = 1.6045e-04, PNorm = 108.6349, GNorm = 0.0032, lr_0 = 9.6262e-04
Validation auc = 0.600065
Epoch 760
Validation auc = 0.600556
Epoch 761
Validation auc = 0.600720
Epoch 762
Validation auc = 0.600665
Epoch 763
Validation auc = 0.600393
Epoch 764
Loss = 2.3504e-04, PNorm = 108.6467, GNorm = 0.0045, lr_0 = 9.6236e-04
Validation auc = 0.600011
Epoch 765
Validation auc = 0.600283
Epoch 766
Validation auc = 0.600011
Epoch 767
Validation auc = 0.600174
Epoch 768
Loss = 1.1666e-01, PNorm = 108.6567, GNorm = 1.3157, lr_0 = 9.6214e-04
Loss = 3.0795e-04, PNorm = 108.6576, GNorm = 0.0117, lr_0 = 9.6212e-04
Validation auc = 0.596304
Epoch 769
Validation auc = 0.593360
Epoch 770
Validation auc = 0.595159
Epoch 771
Validation auc = 0.596685
Epoch 772
Validation auc = 0.598975
Epoch 773
Loss = 7.6436e-04, PNorm = 108.6609, GNorm = 0.0331, lr_0 = 9.6188e-04
Loss = 8.7882e-05, PNorm = 108.6622, GNorm = 0.0035, lr_0 = 9.6186e-04
Validation auc = 0.601210
Epoch 774
Validation auc = 0.602301
Epoch 775
Validation auc = 0.601592
Epoch 776
Validation auc = 0.601210
Epoch 777
Validation auc = 0.600992
Epoch 778
Loss = 1.7676e-03, PNorm = 108.6793, GNorm = 0.0571, lr_0 = 9.6164e-04
Validation auc = 0.601319
Epoch 779
Validation auc = 0.601864
Epoch 780
Validation auc = 0.601755
Epoch 781
Validation auc = 0.601210
Epoch 782
Validation auc = 0.622363
Epoch 783
Loss = 1.0577e-03, PNorm = 108.7142, GNorm = 0.0384, lr_0 = 9.6139e-04
Validation auc = 0.619092
Epoch 784
Validation auc = 0.606880
Epoch 785
Validation auc = 0.595541
Epoch 786
Validation auc = 0.590470
Epoch 787
Loss = 7.8471e-03, PNorm = 108.8204, GNorm = 0.5859, lr_0 = 9.6117e-04
Loss = 1.1389e-03, PNorm = 108.8283, GNorm = 0.0830, lr_0 = 9.6115e-04
Validation auc = 0.592215
Epoch 788
Validation auc = 0.598757
Epoch 789
Validation auc = 0.604045
Epoch 790
Validation auc = 0.614022
Epoch 791
Validation auc = 0.622581
Epoch 792
Loss = 5.0919e-03, PNorm = 108.9173, GNorm = 0.1456, lr_0 = 9.6093e-04
Validation auc = 0.627051
Epoch 793
Validation auc = 0.633157
Epoch 794
Validation auc = 0.634465
Epoch 795
Validation auc = 0.635392
Epoch 796
Validation auc = 0.634793
Epoch 797
Loss = 5.1574e-02, PNorm = 109.0081, GNorm = 0.6651, lr_0 = 9.6067e-04
Validation auc = 0.634738
Epoch 798
Validation auc = 0.633757
Epoch 799
Validation auc = 0.632285
Epoch 800
Validation auc = 0.630922
Epoch 801
Loss = 2.0231e-03, PNorm = 109.0590, GNorm = 0.0353, lr_0 = 9.6045e-04
Loss = 2.1867e-02, PNorm = 109.0628, GNorm = 2.0850, lr_0 = 9.6043e-04
Validation auc = 0.629014
Epoch 802
Validation auc = 0.622908
Epoch 803
Validation auc = 0.625961
Epoch 804
Validation auc = 0.621163
Epoch 805
Validation auc = 0.616966
Epoch 806
Loss = 9.4899e-03, PNorm = 109.1600, GNorm = 0.0359, lr_0 = 9.6019e-04
Loss = 3.7024e-03, PNorm = 109.1684, GNorm = 0.1571, lr_0 = 9.6018e-04
Validation auc = 0.611677
Epoch 807
Validation auc = 0.607807
Epoch 808
Validation auc = 0.603336
Epoch 809
Validation auc = 0.595922
Epoch 810
Validation auc = 0.586927
Epoch 811
Loss = 3.5392e-02, PNorm = 109.2880, GNorm = 1.0231, lr_0 = 9.5996e-04
Validation auc = 0.584801
Epoch 812
Validation auc = 0.583165
Epoch 813
Validation auc = 0.582457
Epoch 814
Validation auc = 0.582293
Epoch 815
Validation auc = 0.582129
Epoch 816
Loss = 2.5226e-04, PNorm = 109.3861, GNorm = 0.0067, lr_0 = 9.5970e-04
Validation auc = 0.582566
Epoch 817
Validation auc = 0.585673
Epoch 818
Validation auc = 0.588017
Epoch 819
Validation auc = 0.589598
Epoch 820
Loss = 5.8145e-04, PNorm = 109.4311, GNorm = 0.0152, lr_0 = 9.5948e-04
Loss = 3.1816e-04, PNorm = 109.4342, GNorm = 0.0097, lr_0 = 9.5946e-04
Validation auc = 0.592706
Epoch 821
Validation auc = 0.595213
Epoch 822
Validation auc = 0.597558
Epoch 823
Validation auc = 0.599030
Epoch 824
Validation auc = 0.600447
Epoch 825
Loss = 7.5186e-04, PNorm = 109.4618, GNorm = 0.0172, lr_0 = 9.5924e-04
Validation auc = 0.602246
Epoch 826
Validation auc = 0.604045
Epoch 827
Validation auc = 0.607044
Epoch 828
Validation auc = 0.606280
Epoch 829
Validation auc = 0.606171
Epoch 830
Loss = 5.2817e-04, PNorm = 109.4801, GNorm = 0.0154, lr_0 = 9.5899e-04
Validation auc = 0.605463
Epoch 831
Validation auc = 0.605572
Epoch 832
Validation auc = 0.606226
Epoch 833
Validation auc = 0.607153
Epoch 834
Loss = 7.8548e-04, PNorm = 109.4927, GNorm = 0.0065, lr_0 = 9.5877e-04
Loss = 3.6337e-05, PNorm = 109.4935, GNorm = 0.0014, lr_0 = 9.5875e-04
Validation auc = 0.607643
Epoch 835
Validation auc = 0.608297
Epoch 836
Validation auc = 0.610151
Epoch 837
Validation auc = 0.611296
Epoch 838
Validation auc = 0.620400
Epoch 839
Loss = 1.5766e-03, PNorm = 109.5228, GNorm = 0.0795, lr_0 = 9.5851e-04
Loss = 2.0875e-03, PNorm = 109.5271, GNorm = 0.1062, lr_0 = 9.5849e-04
Validation auc = 0.625525
Epoch 840
Validation auc = 0.627978
Epoch 841
Validation auc = 0.625089
Epoch 842
Validation auc = 0.624271
Epoch 843
Validation auc = 0.623508
Epoch 844
Loss = 5.9130e-02, PNorm = 109.5757, GNorm = 0.6995, lr_0 = 9.5827e-04
Validation auc = 0.622417
Epoch 845
Validation auc = 0.622526
Epoch 846
Validation auc = 0.623071
Epoch 847
Validation auc = 0.622526
Epoch 848
Validation auc = 0.621818
Epoch 849
Loss = 1.9321e-02, PNorm = 109.6045, GNorm = 1.1836, lr_0 = 9.5802e-04
Validation auc = 0.618219
Epoch 850
Validation auc = 0.615221
Epoch 851
Validation auc = 0.612931
Epoch 852
Validation auc = 0.610533
Epoch 853
Loss = 6.6429e-03, PNorm = 109.6267, GNorm = 0.0267, lr_0 = 9.5780e-04
Loss = 6.3533e-05, PNorm = 109.6280, GNorm = 0.0019, lr_0 = 9.5778e-04
Validation auc = 0.609170
Epoch 854
Validation auc = 0.608025
Epoch 855
Validation auc = 0.606716
Epoch 856
Validation auc = 0.614131
Epoch 857
Validation auc = 0.622472
Epoch 858
Loss = 3.3270e-03, PNorm = 109.6567, GNorm = 0.0088, lr_0 = 9.5754e-04
Validation auc = 0.621218
Epoch 859
Validation auc = 0.620400
Epoch 860
Validation auc = 0.619910
Epoch 861
Validation auc = 0.619364
Epoch 862
Validation auc = 0.618928
Epoch 863
Loss = 4.4070e-04, PNorm = 109.6871, GNorm = 0.0133, lr_0 = 9.5730e-04
Validation auc = 0.618110
Epoch 864
Validation auc = 0.617783
Epoch 865
Validation auc = 0.617184
Epoch 866
Validation auc = 0.617020
Epoch 867
Loss = 7.0184e-04, PNorm = 109.7017, GNorm = 0.0160, lr_0 = 9.5708e-04
Loss = 1.5469e-04, PNorm = 109.7026, GNorm = 0.0052, lr_0 = 9.5707e-04
Validation auc = 0.616693
Epoch 868
Validation auc = 0.616584
Epoch 869
Validation auc = 0.616311
Epoch 870
Validation auc = 0.616093
Epoch 871
Validation auc = 0.616039
Epoch 872
Loss = 2.0197e-04, PNorm = 109.7102, GNorm = 0.0065, lr_0 = 9.5683e-04
Loss = 8.5432e-06, PNorm = 109.7105, GNorm = 0.0003, lr_0 = 9.5681e-04
Validation auc = 0.616093
Epoch 873
Validation auc = 0.616366
Epoch 874
Validation auc = 0.616584
Epoch 875
Validation auc = 0.616366
Epoch 876
Validation auc = 0.615984
Epoch 877
Loss = 1.0415e-04, PNorm = 109.7145, GNorm = 0.0027, lr_0 = 9.5659e-04
Validation auc = 0.615657
Epoch 878
Validation auc = 0.615003
Epoch 879
Validation auc = 0.614676
Epoch 880
Validation auc = 0.614294
Epoch 881
Validation auc = 0.612604
Epoch 882
Loss = 9.0129e-05, PNorm = 109.7247, GNorm = 0.0020, lr_0 = 9.5634e-04
Validation auc = 0.610860
Epoch 883
Validation auc = 0.608897
Epoch 884
Validation auc = 0.607752
Epoch 885
Validation auc = 0.607425
Epoch 886
Loss = 3.0627e-03, PNorm = 109.7361, GNorm = 0.0051, lr_0 = 9.5612e-04
Loss = 3.5403e-05, PNorm = 109.7362, GNorm = 0.0013, lr_0 = 9.5610e-04
Validation auc = 0.609333
Epoch 887
Validation auc = 0.609824
Epoch 888
Validation auc = 0.611023
Epoch 889
Validation auc = 0.611514
Epoch 890
Validation auc = 0.612223
Epoch 891
Loss = 1.4963e-04, PNorm = 109.7386, GNorm = 0.0064, lr_0 = 9.5586e-04
Validation auc = 0.612386
Epoch 892
Validation auc = 0.613749
Epoch 893
Validation auc = 0.614294
Epoch 894
Validation auc = 0.615930
Epoch 895
Validation auc = 0.616311
Epoch 896
Loss = 2.4564e-04, PNorm = 109.7467, GNorm = 0.0085, lr_0 = 9.5563e-04
Validation auc = 0.616039
Epoch 897
Validation auc = 0.616366
Epoch 898
Validation auc = 0.616529
Epoch 899
Validation auc = 0.616475
Epoch 900
Loss = 2.4945e-04, PNorm = 109.7508, GNorm = 0.0061, lr_0 = 9.5541e-04
Loss = 1.6140e-04, PNorm = 109.7510, GNorm = 0.0066, lr_0 = 9.5539e-04
Validation auc = 0.616802
Epoch 901
Validation auc = 0.617783
Epoch 902
Validation auc = 0.617674
Epoch 903
Validation auc = 0.617347
Epoch 904
Validation auc = 0.614076
Epoch 905
Loss = 7.0355e-02, PNorm = 109.7726, GNorm = 1.3860, lr_0 = 9.5515e-04
Loss = 1.4270e-03, PNorm = 109.7754, GNorm = 0.0707, lr_0 = 9.5513e-04
Validation auc = 0.610478
Epoch 906
Validation auc = 0.607916
Epoch 907
Validation auc = 0.606008
Epoch 908
Validation auc = 0.603664
Epoch 909
Validation auc = 0.601646
Epoch 910
Loss = 6.7773e-04, PNorm = 109.7870, GNorm = 0.0238, lr_0 = 9.5491e-04
Validation auc = 0.599357
Epoch 911
Validation auc = 0.598975
Epoch 912
Validation auc = 0.598866
Epoch 913
Validation auc = 0.599520
Epoch 914
Validation auc = 0.602083
Epoch 915
Loss = 2.1633e-04, PNorm = 109.8085, GNorm = 0.0100, lr_0 = 9.5466e-04
Validation auc = 0.604590
Epoch 916
Validation auc = 0.606553
Epoch 917
Validation auc = 0.607480
Epoch 918
Validation auc = 0.608188
Epoch 919
Loss = 2.8074e-04, PNorm = 109.8207, GNorm = 0.0051, lr_0 = 9.5444e-04
Loss = 9.5763e-06, PNorm = 109.8212, GNorm = 0.0004, lr_0 = 9.5442e-04
Validation auc = 0.609170
Epoch 920
Validation auc = 0.610206
Epoch 921
Validation auc = 0.607534
Epoch 922
Validation auc = 0.600338
Epoch 923
Validation auc = 0.596249
Epoch 924
Loss = 1.0030e-02, PNorm = 109.8799, GNorm = 0.6248, lr_0 = 9.5419e-04
Validation auc = 0.592760
Epoch 925
Validation auc = 0.587090
Epoch 926
Validation auc = 0.584038
Epoch 927
Validation auc = 0.588671
Epoch 928
Validation auc = 0.591615
Epoch 929
Loss = 8.2011e-04, PNorm = 109.9587, GNorm = 0.0191, lr_0 = 9.5395e-04
Validation auc = 0.593905
Epoch 930
Validation auc = 0.595377
Epoch 931
Validation auc = 0.596195
Epoch 932
Validation auc = 0.599793
Epoch 933
Loss = 1.5729e-03, PNorm = 110.0032, GNorm = 0.0011, lr_0 = 9.5371e-04
Validation auc = 0.605572
Epoch 934
Validation auc = 0.609170
Epoch 935
Validation auc = 0.611896
Epoch 936
Validation auc = 0.611950
Epoch 937
Validation auc = 0.612114
Epoch 938
Loss = 1.7167e-03, PNorm = 110.0314, GNorm = 0.0425, lr_0 = 9.5348e-04
Loss = 3.5113e-04, PNorm = 110.0326, GNorm = 0.0120, lr_0 = 9.5346e-04
Validation auc = 0.613313
Epoch 939
Validation auc = 0.612931
Epoch 940
Validation auc = 0.612986
Epoch 941
Validation auc = 0.612986
Epoch 942
Validation auc = 0.612768
Epoch 943
Loss = 1.2647e-04, PNorm = 110.0437, GNorm = 0.0023, lr_0 = 9.5324e-04
Validation auc = 0.612931
Epoch 944
Validation auc = 0.613204
Epoch 945
Validation auc = 0.614076
Epoch 946
Validation auc = 0.615385
Epoch 947
Validation auc = 0.616420
Epoch 948
Loss = 7.1916e-05, PNorm = 110.0518, GNorm = 0.0015, lr_0 = 9.5299e-04
Validation auc = 0.616638
Epoch 949
Validation auc = 0.617620
Epoch 950
Validation auc = 0.619201
Epoch 951
Validation auc = 0.619746
Epoch 952
Loss = 1.1106e-03, PNorm = 110.0673, GNorm = 0.0330, lr_0 = 9.5277e-04
Loss = 6.4452e-04, PNorm = 110.0684, GNorm = 0.0259, lr_0 = 9.5275e-04
Validation auc = 0.620128
Epoch 953
Validation auc = 0.619964
Epoch 954
Validation auc = 0.619964
Epoch 955
Validation auc = 0.619746
Epoch 956
Validation auc = 0.619201
Epoch 957
Loss = 2.2110e-03, PNorm = 110.0760, GNorm = 0.0037, lr_0 = 9.5251e-04
Loss = 2.8351e-05, PNorm = 110.0762, GNorm = 0.0011, lr_0 = 9.5250e-04
Validation auc = 0.619146
Epoch 958
Validation auc = 0.618874
Epoch 959
Validation auc = 0.618656
Epoch 960
Validation auc = 0.618438
Epoch 961
Validation auc = 0.618274
Epoch 962
Loss = 6.5061e-05, PNorm = 110.0775, GNorm = 0.0014, lr_0 = 9.5228e-04
Validation auc = 0.618219
Epoch 963
Validation auc = 0.618438
Epoch 964
Validation auc = 0.618329
Epoch 965
Validation auc = 0.619910
Epoch 966
Loss = 1.7587e-04, PNorm = 110.0810, GNorm = 0.0033, lr_0 = 9.5204e-04
Validation auc = 0.621981
Epoch 967
Validation auc = 0.623453
Epoch 968
Validation auc = 0.623508
Epoch 969
Validation auc = 0.624434
Epoch 970
Validation auc = 0.624652
Epoch 971
Loss = 3.4807e-04, PNorm = 110.1027, GNorm = 0.0152, lr_0 = 9.5180e-04
Loss = 6.4426e-03, PNorm = 110.1036, GNorm = 0.7441, lr_0 = 9.5179e-04
Validation auc = 0.626997
Epoch 972
Validation auc = 0.631685
Epoch 973
Validation auc = 0.635719
Epoch 974
Validation auc = 0.638827
Epoch 975
Validation auc = 0.640026
Epoch 976
Loss = 4.2186e-03, PNorm = 110.1235, GNorm = 0.1481, lr_0 = 9.5157e-04
Validation auc = 0.641117
Epoch 977
Validation auc = 0.638663
Epoch 978
Validation auc = 0.637573
Epoch 979
Validation auc = 0.635447
Epoch 980
Validation auc = 0.634302
Epoch 981
Loss = 3.1049e-05, PNorm = 110.1569, GNorm = 0.0008, lr_0 = 9.5132e-04
Validation auc = 0.633484
Epoch 982
Validation auc = 0.633321
Epoch 983
Validation auc = 0.640353
Epoch 984
Validation auc = 0.645914
Epoch 985
Loss = 1.3759e-01, PNorm = 110.2930, GNorm = 3.5054, lr_0 = 9.5110e-04
Loss = 2.7878e-02, PNorm = 110.3389, GNorm = 0.8762, lr_0 = 9.5108e-04
Validation auc = 0.635065
Epoch 986
Validation auc = 0.619419
Epoch 987
Validation auc = 0.612550
Epoch 988
Validation auc = 0.623835
Epoch 989
Validation auc = 0.636537
Epoch 990
Loss = 3.2214e-02, PNorm = 111.0294, GNorm = 0.4959, lr_0 = 9.5084e-04
Loss = 5.0299e-02, PNorm = 111.0692, GNorm = 2.7827, lr_0 = 9.5083e-04
Validation auc = 0.644606
Epoch 991
Validation auc = 0.644388
Epoch 992
Validation auc = 0.637736
Epoch 993
Validation auc = 0.638227
Epoch 994
Validation auc = 0.646677
Epoch 995
Loss = 7.6921e-02, PNorm = 111.4543, GNorm = 0.4639, lr_0 = 9.5061e-04
Validation auc = 0.651529
Epoch 996
Validation auc = 0.655236
Epoch 997
Validation auc = 0.659434
Epoch 998
Validation auc = 0.668102
Epoch 999
Loss = 2.1221e-02, PNorm = 111.7749, GNorm = 0.0052, lr_0 = 9.5037e-04
Validation auc = 0.665049
Epoch 1000
Validation auc = 0.664613
Epoch 1001
Validation auc = 0.668211
Epoch 1002
Validation auc = 0.672300
Epoch 1003
Validation auc = 0.655018
Epoch 1004
Loss = 1.9766e-03, PNorm = 112.0444, GNorm = 0.0260, lr_0 = 9.5014e-04
Loss = 4.1254e-04, PNorm = 112.0613, GNorm = 0.0088, lr_0 = 9.5012e-04
Validation auc = 0.642697
Epoch 1005
Validation auc = 0.653492
Epoch 1006
Validation auc = 0.662487
Epoch 1007
Validation auc = 0.667230
Epoch 1008
Validation auc = 0.663032
Epoch 1009
Loss = 2.1122e-02, PNorm = 112.2781, GNorm = 0.5426, lr_0 = 9.4990e-04
Validation auc = 0.665158
Epoch 1010
Validation auc = 0.658616
Epoch 1011
Validation auc = 0.658235
Epoch 1012
Validation auc = 0.651802
Epoch 1013
Validation auc = 0.643406
Epoch 1014
Loss = 1.3512e-01, PNorm = 112.5909, GNorm = 1.4788, lr_0 = 9.4965e-04
Validation auc = 0.647059
Epoch 1015
Validation auc = 0.641007
Epoch 1016
Validation auc = 0.633266
Epoch 1017
Validation auc = 0.628087
Epoch 1018
Loss = 1.6847e-02, PNorm = 112.9294, GNorm = 0.4759, lr_0 = 9.4943e-04
Loss = 4.8458e-02, PNorm = 112.9464, GNorm = 1.5800, lr_0 = 9.4941e-04
Validation auc = 0.625089
Epoch 1019
Validation auc = 0.628850
Epoch 1020
Validation auc = 0.634029
Epoch 1021
Validation auc = 0.634684
Epoch 1022
Validation auc = 0.635856
Epoch 1023
Loss = 3.9115e-03, PNorm = 113.1134, GNorm = 0.0618, lr_0 = 9.4918e-04
Loss = 4.3420e-02, PNorm = 113.1240, GNorm = 0.7990, lr_0 = 9.4916e-04
Validation auc = 0.637382
Epoch 1024
Validation auc = 0.636128
Epoch 1025
Validation auc = 0.619201
Epoch 1026
Validation auc = 0.603227
Epoch 1027
Validation auc = 0.602628
Epoch 1028
Loss = 4.7749e-03, PNorm = 113.2800, GNorm = 0.1628, lr_0 = 9.4894e-04
Validation auc = 0.604754
Epoch 1029
Validation auc = 0.600611
Epoch 1030
Validation auc = 0.596413
Epoch 1031
Validation auc = 0.605026
Epoch 1032
Validation auc = 0.613695
Epoch 1033
Loss = 4.4054e-03, PNorm = 113.4066, GNorm = 0.0864, lr_0 = 9.4869e-04
Validation auc = 0.616693
Epoch 1034
Validation auc = 0.619037
Epoch 1035
Validation auc = 0.616857
Epoch 1036
Validation auc = 0.613804
Epoch 1037
Loss = 8.2920e-03, PNorm = 113.5039, GNorm = 0.0486, lr_0 = 9.4847e-04
Loss = 3.0067e-04, PNorm = 113.5101, GNorm = 0.0084, lr_0 = 9.4845e-04
Validation auc = 0.623889
Epoch 1038
Validation auc = 0.634820
Epoch 1039
Validation auc = 0.644115
Epoch 1040
Validation auc = 0.618874
Epoch 1041
Validation auc = 0.604699
Epoch 1042
Loss = 2.1135e-01, PNorm = 113.9727, GNorm = 2.5439, lr_0 = 9.4823e-04
Validation auc = 0.609497
Epoch 1043
Validation auc = 0.617783
Epoch 1044
Validation auc = 0.628905
Epoch 1045
Validation auc = 0.613967
Epoch 1046
Validation auc = 0.601701
Epoch 1047
Loss = 6.2147e-03, PNorm = 114.4561, GNorm = 0.1866, lr_0 = 9.4798e-04
Validation auc = 0.598839
Epoch 1048
Validation auc = 0.625443
Epoch 1049
Validation auc = 0.644497
Epoch 1050
Validation auc = 0.650493
Epoch 1051
Loss = 3.2794e-03, PNorm = 114.6335, GNorm = 0.0386, lr_0 = 9.4776e-04
Loss = 2.2766e-03, PNorm = 114.6420, GNorm = 0.0777, lr_0 = 9.4775e-04
Validation auc = 0.653274
Epoch 1052
Validation auc = 0.655127
Epoch 1053
Validation auc = 0.654037
Epoch 1054
Validation auc = 0.654582
Epoch 1055
Validation auc = 0.651638
Epoch 1056
Loss = 2.9021e-03, PNorm = 114.7404, GNorm = 0.0682, lr_0 = 9.4751e-04
Loss = 3.0976e-03, PNorm = 114.7484, GNorm = 0.1269, lr_0 = 9.4749e-04
Validation auc = 0.644551
Epoch 1057
Validation auc = 0.640517
Epoch 1058
Validation auc = 0.638445
Epoch 1059
Validation auc = 0.637191
Epoch 1060
Validation auc = 0.637791
Epoch 1061
Loss = 9.9690e-04, PNorm = 114.8251, GNorm = 0.0209, lr_0 = 9.4728e-04
Validation auc = 0.637300
Epoch 1062
Validation auc = 0.633266
Epoch 1063
Validation auc = 0.626179
Epoch 1064
Validation auc = 0.622472
Epoch 1065
Validation auc = 0.619637
Epoch 1066
Loss = 2.4448e-03, PNorm = 114.8813, GNorm = 0.0482, lr_0 = 9.4702e-04
Validation auc = 0.616311
Epoch 1067
Validation auc = 0.614512
Epoch 1068
Validation auc = 0.613695
Epoch 1069
Validation auc = 0.602928
Epoch 1070
Loss = 3.3924e-02, PNorm = 114.9079, GNorm = 1.7937, lr_0 = 9.4681e-04
Loss = 3.8866e-04, PNorm = 114.9098, GNorm = 0.0128, lr_0 = 9.4679e-04
Validation auc = 0.603064
Epoch 1071
Validation auc = 0.601592
Epoch 1072
Validation auc = 0.601701
Epoch 1073
Validation auc = 0.600720
Epoch 1074
Validation auc = 0.600447
Epoch 1075
Loss = 6.8291e-04, PNorm = 114.9371, GNorm = 0.0209, lr_0 = 9.4657e-04
Validation auc = 0.599738
Epoch 1076
Validation auc = 0.600720
Epoch 1077
Validation auc = 0.600229
Epoch 1078
Validation auc = 0.599084
Epoch 1079
Validation auc = 0.598375
Epoch 1080
Loss = 3.6811e-04, PNorm = 114.9676, GNorm = 0.0059, lr_0 = 9.4632e-04
Validation auc = 0.598103
Epoch 1081
Validation auc = 0.598103
Epoch 1082
Validation auc = 0.596249
Epoch 1083
Validation auc = 0.594287
Epoch 1084
Loss = 1.2866e-02, PNorm = 114.9922, GNorm = 0.8459, lr_0 = 9.4610e-04
Loss = 2.6954e-03, PNorm = 114.9973, GNorm = 0.0810, lr_0 = 9.4608e-04
Validation auc = 0.591506
Epoch 1085
Validation auc = 0.587636
Epoch 1086
Validation auc = 0.587772
Epoch 1087
Validation auc = 0.590798
Epoch 1088
Validation auc = 0.592324
Epoch 1089
Loss = 1.8459e-03, PNorm = 115.0652, GNorm = 0.0464, lr_0 = 9.4585e-04
Loss = 1.6899e-04, PNorm = 115.0691, GNorm = 0.0068, lr_0 = 9.4583e-04
Validation auc = 0.593687
Epoch 1090
Validation auc = 0.594832
Epoch 1091
Validation auc = 0.596522
Epoch 1092
Validation auc = 0.598893
Epoch 1093
Validation auc = 0.600011
Epoch 1094
Loss = 4.6847e-03, PNorm = 115.1334, GNorm = 0.1990, lr_0 = 9.4561e-04
Validation auc = 0.602001
Epoch 1095
Validation auc = 0.602164
Epoch 1096
Validation auc = 0.601864
Epoch 1097
Validation auc = 0.601946
Epoch 1098
Validation auc = 0.602410
Epoch 1099
Loss = 2.9019e-04, PNorm = 115.1949, GNorm = 0.0108, lr_0 = 9.4536e-04
Validation auc = 0.602709
Epoch 1100
Validation auc = 0.602546
Epoch 1101
Validation auc = 0.604618
Epoch 1102
Validation auc = 0.606798
Epoch 1103
Loss = 2.2881e-03, PNorm = 115.2162, GNorm = 0.0443, lr_0 = 9.4515e-04
Loss = 3.3696e-04, PNorm = 115.2177, GNorm = 0.0089, lr_0 = 9.4513e-04
Validation auc = 0.608107
Epoch 1104
Validation auc = 0.608079
Epoch 1105
Validation auc = 0.608979
Epoch 1106
Validation auc = 0.609470
Epoch 1107
Validation auc = 0.612304
Epoch 1108
Loss = 9.4768e-03, PNorm = 115.2473, GNorm = 0.7615, lr_0 = 9.4489e-04
Validation auc = 0.611950
Epoch 1109
Validation auc = 0.611787
Epoch 1110
Validation auc = 0.610069
Epoch 1111
Validation auc = 0.611459
Epoch 1112
Validation auc = 0.611432
Epoch 1113
Loss = 7.4078e-04, PNorm = 115.2931, GNorm = 0.0166, lr_0 = 9.4466e-04
Validation auc = 0.611732
Epoch 1114
Validation auc = 0.612250
Epoch 1115
Validation auc = 0.612904
Epoch 1116
Validation auc = 0.613013
Epoch 1117
Loss = 3.1355e-03, PNorm = 115.3174, GNorm = 0.0210, lr_0 = 9.4444e-04
Loss = 3.0556e-04, PNorm = 115.3191, GNorm = 0.0118, lr_0 = 9.4443e-04
Validation auc = 0.613586
Epoch 1118
Validation auc = 0.614431
Epoch 1119
Validation auc = 0.629913
Epoch 1120
Validation auc = 0.648285
Epoch 1121
Validation auc = 0.625797
Epoch 1122
Loss = 1.2564e-01, PNorm = 115.5506, GNorm = 0.0311, lr_0 = 9.4419e-04
Loss = 6.8046e-02, PNorm = 115.5988, GNorm = 3.6972, lr_0 = 9.4417e-04
Validation auc = 0.603173
Epoch 1123
Validation auc = 0.601374
Epoch 1124
Validation auc = 0.597558
Epoch 1125
Validation auc = 0.593033
Epoch 1126
Validation auc = 0.579186
Epoch 1127
Loss = 1.2169e-02, PNorm = 116.2670, GNorm = 0.1843, lr_0 = 9.4396e-04
Validation auc = 0.561086
Epoch 1128
Validation auc = 0.576569
Epoch 1129
Validation auc = 0.596849
Epoch 1130
Validation auc = 0.619092
Epoch 1131
Validation auc = 0.621381
Epoch 1132
Loss = 3.6159e-01, PNorm = 117.0067, GNorm = 2.3471, lr_0 = 9.4371e-04
Validation auc = 0.651965
Epoch 1133
Validation auc = 0.670556
Epoch 1134
Validation auc = 0.669738
Epoch 1135
Validation auc = 0.641280
Epoch 1136
Loss = 7.9254e-02, PNorm = 117.8056, GNorm = 1.1915, lr_0 = 9.4349e-04
Loss = 4.4232e-01, PNorm = 117.8674, GNorm = 6.1239, lr_0 = 9.4347e-04
Validation auc = 0.646132
Epoch 1137
Validation auc = 0.657635
Epoch 1138
Validation auc = 0.658562
Epoch 1139
Validation auc = 0.659162
Epoch 1140
Validation auc = 0.666358
Epoch 1141
Loss = 5.2037e-02, PNorm = 118.6626, GNorm = 2.1857, lr_0 = 9.4324e-04
Validation auc = 0.659761
Epoch 1142
Validation auc = 0.651747
Epoch 1143
Validation auc = 0.653165
Epoch 1144
Validation auc = 0.649076
Epoch 1145
Validation auc = 0.635774
Epoch 1146
Loss = 5.7053e-02, PNorm = 119.3326, GNorm = 0.7837, lr_0 = 9.4300e-04
Validation auc = 0.630867
Epoch 1147
Validation auc = 0.632721
Epoch 1148
Validation auc = 0.632448
Epoch 1149
Validation auc = 0.628087
Epoch 1150
Loss = 6.6628e-03, PNorm = 119.7245, GNorm = 0.1543, lr_0 = 9.4279e-04
Loss = 9.4478e-04, PNorm = 119.7450, GNorm = 0.0550, lr_0 = 9.4277e-04
Validation auc = 0.621872
Epoch 1151
Validation auc = 0.612877
Epoch 1152
Validation auc = 0.610042
Epoch 1153
Validation auc = 0.615930
Epoch 1154
Validation auc = 0.631058
Epoch 1155
Loss = 2.4902e-02, PNorm = 119.9181, GNorm = 0.0385, lr_0 = 9.4253e-04
Loss = 1.7562e-03, PNorm = 119.9300, GNorm = 0.1634, lr_0 = 9.4252e-04
Validation auc = 0.647004
Epoch 1156
Validation auc = 0.652074
Epoch 1157
Validation auc = 0.664068
Epoch 1158
Validation auc = 0.666412
Epoch 1159
Validation auc = 0.672409
Epoch 1160
Loss = 7.8313e-03, PNorm = 120.1301, GNorm = 0.1992, lr_0 = 9.4230e-04
Validation auc = 0.680096
Epoch 1161
Validation auc = 0.674699
Epoch 1162
Validation auc = 0.665104
Epoch 1163
Validation auc = 0.648204
Epoch 1164
Validation auc = 0.645641
Epoch 1165
Loss = 5.6794e-02, PNorm = 120.4256, GNorm = 1.4916, lr_0 = 9.4205e-04
Validation auc = 0.637600
Epoch 1166
Validation auc = 0.636646
Epoch 1167
Validation auc = 0.632121
Epoch 1168
Validation auc = 0.619691
Epoch 1169
Loss = 5.7138e-03, PNorm = 120.7612, GNorm = 0.7723, lr_0 = 9.4183e-04
Loss = 3.8136e-03, PNorm = 120.7852, GNorm = 0.1163, lr_0 = 9.4182e-04
Validation auc = 0.617511
Epoch 1170
Validation auc = 0.636701
Epoch 1171
Validation auc = 0.627324
Epoch 1172
Validation auc = 0.672518
Epoch 1173
Validation auc = 0.697923
Epoch 1174
Loss = 6.9001e-02, PNorm = 121.3573, GNorm = 1.2201, lr_0 = 9.4158e-04
Validation auc = 0.667175
Epoch 1175
Validation auc = 0.632012
Epoch 1176
Validation auc = 0.613367
Epoch 1177
Validation auc = 0.619582
Epoch 1178
Validation auc = 0.633157
Epoch 1179
Loss = 9.6989e-02, PNorm = 122.4692, GNorm = 1.0898, lr_0 = 9.4135e-04
Validation auc = 0.649975
Epoch 1180
Validation auc = 0.666003
Epoch 1181
Validation auc = 0.674235
Epoch 1182
Validation auc = 0.671591
Epoch 1183
Loss = 8.9493e-02, PNorm = 123.2129, GNorm = 0.5493, lr_0 = 9.4112e-04
Validation auc = 0.672082
Epoch 1184
Validation auc = 0.667721
Epoch 1185
Validation auc = 0.663795
Epoch 1186
Validation auc = 0.659325
Epoch 1187
Validation auc = 0.656163
Epoch 1188
Loss = 1.2180e-02, PNorm = 123.6297, GNorm = 0.7801, lr_0 = 9.4088e-04
Loss = 2.2646e-02, PNorm = 123.6475, GNorm = 0.9423, lr_0 = 9.4087e-04
Validation auc = 0.655345
Epoch 1189
Validation auc = 0.658453
Epoch 1190
Validation auc = 0.665485
Epoch 1191
Validation auc = 0.661915
Epoch 1192
Validation auc = 0.663577
Epoch 1193
Loss = 5.2415e-02, PNorm = 123.8094, GNorm = 1.1035, lr_0 = 9.4065e-04
Validation auc = 0.660797
Epoch 1194
Validation auc = 0.657035
Epoch 1195
Validation auc = 0.657962
Epoch 1196
Validation auc = 0.657744
Epoch 1197
Validation auc = 0.654582
Epoch 1198
Loss = 1.3366e-02, PNorm = 123.9992, GNorm = 0.2526, lr_0 = 9.4040e-04
Validation auc = 0.647222
Epoch 1199
Validation auc = 0.646187
Epoch 1200
Validation auc = 0.650602
Epoch 1201
Validation auc = 0.652238
Epoch 1202
Loss = 3.5074e-02, PNorm = 124.2202, GNorm = 0.7560, lr_0 = 9.4018e-04
Loss = 1.9164e-02, PNorm = 124.2399, GNorm = 0.6817, lr_0 = 9.4016e-04
Validation auc = 0.652020
Epoch 1203
Validation auc = 0.656327
Epoch 1204
Validation auc = 0.655236
Epoch 1205
Validation auc = 0.651093
Epoch 1206
Validation auc = 0.648476
Epoch 1207
Loss = 1.9092e-02, PNorm = 124.5450, GNorm = 0.2716, lr_0 = 9.3993e-04
Loss = 1.9430e-02, PNorm = 124.5758, GNorm = 0.5965, lr_0 = 9.3991e-04
Validation auc = 0.642425
Epoch 1208
Validation auc = 0.637082
Epoch 1209
Validation auc = 0.636701
Epoch 1210
Validation auc = 0.638881
Epoch 1211
Validation auc = 0.652129
Epoch 1212
Loss = 2.7466e-02, PNorm = 124.9427, GNorm = 0.5786, lr_0 = 9.3970e-04
Validation auc = 0.656490
Epoch 1213
Validation auc = 0.658071
Epoch 1214
Validation auc = 0.655945
Epoch 1215
Validation auc = 0.650602
Epoch 1216
Loss = 5.0869e-03, PNorm = 125.1846, GNorm = 0.0265, lr_0 = 9.3946e-04
Validation auc = 0.646677
Epoch 1217
Validation auc = 0.644169
Epoch 1218
Validation auc = 0.641662
Epoch 1219
Validation auc = 0.639754
Epoch 1220
Validation auc = 0.638227
Epoch 1221
Loss = 4.3408e-03, PNorm = 125.2916, GNorm = 0.1170, lr_0 = 9.3923e-04
Loss = 7.7812e-01, PNorm = 125.2968, GNorm = 6.3657, lr_0 = 9.3922e-04
Validation auc = 0.639099
Epoch 1222
Validation auc = 0.647113
Epoch 1223
Validation auc = 0.648858
Epoch 1224
Validation auc = 0.651093
Epoch 1225
Validation auc = 0.654201
Epoch 1226
Loss = 1.4298e-02, PNorm = 125.5071, GNorm = 0.4964, lr_0 = 9.3900e-04
Validation auc = 0.654637
Epoch 1227
Validation auc = 0.653219
Epoch 1228
Validation auc = 0.653328
Epoch 1229
Validation auc = 0.655073
Epoch 1230
Validation auc = 0.658017
Epoch 1231
Loss = 1.2348e-03, PNorm = 125.6549, GNorm = 0.0246, lr_0 = 9.3875e-04
Validation auc = 0.659598
Epoch 1232
Validation auc = 0.661615
Epoch 1233
Validation auc = 0.661778
Epoch 1234
Validation auc = 0.662596
Epoch 1235
Loss = 1.4556e-03, PNorm = 125.7111, GNorm = 0.1311, lr_0 = 9.3853e-04
Loss = 9.5849e-04, PNorm = 125.7140, GNorm = 0.0302, lr_0 = 9.3852e-04
Validation auc = 0.662324
Epoch 1236
Validation auc = 0.662324
Epoch 1237
Validation auc = 0.663795
Epoch 1238
Validation auc = 0.663523
Epoch 1239
Validation auc = 0.664940
Epoch 1240
Loss = 4.2707e-03, PNorm = 125.7407, GNorm = 0.0315, lr_0 = 9.3828e-04
Loss = 6.4638e-03, PNorm = 125.7432, GNorm = 0.2900, lr_0 = 9.3827e-04
Validation auc = 0.668320
Epoch 1241
Validation auc = 0.669847
Epoch 1242
Validation auc = 0.670828
Epoch 1243
Validation auc = 0.670937
Epoch 1244
Validation auc = 0.671537
Epoch 1245
Loss = 6.5231e-03, PNorm = 125.7720, GNorm = 0.1698, lr_0 = 9.3805e-04
Validation auc = 0.672736
Epoch 1246
Validation auc = 0.671537
Epoch 1247
Validation auc = 0.677425
Epoch 1248
Validation auc = 0.679006
Epoch 1249
Loss = 5.6084e-04, PNorm = 125.8148, GNorm = 0.0065, lr_0 = 9.3782e-04
Validation auc = 0.680150
Epoch 1250
Validation auc = 0.681950
Epoch 1251
Validation auc = 0.681895
Epoch 1252
Validation auc = 0.681950
Epoch 1253
Validation auc = 0.678733
Epoch 1254
Loss = 6.1826e-04, PNorm = 125.8533, GNorm = 0.0142, lr_0 = 9.3758e-04
Loss = 9.8380e-04, PNorm = 125.8559, GNorm = 0.0355, lr_0 = 9.3757e-04
Validation auc = 0.676116
Epoch 1255
Validation auc = 0.675408
Epoch 1256
Validation auc = 0.686256
Epoch 1257
Validation auc = 0.694379
Epoch 1258
Validation auc = 0.694107
Epoch 1259
Loss = 2.0141e-03, PNorm = 126.0113, GNorm = 0.0519, lr_0 = 9.3735e-04
Validation auc = 0.675844
Epoch 1260
Validation auc = 0.658398
Epoch 1261
Validation auc = 0.642043
Epoch 1262
Validation auc = 0.624162
Epoch 1263
Validation auc = 0.612086
Epoch 1264
Loss = 6.7654e-03, PNorm = 126.4462, GNorm = 0.2062, lr_0 = 9.3710e-04
Validation auc = 0.606335
Epoch 1265
Validation auc = 0.603500
Epoch 1266
Validation auc = 0.592978
Epoch 1267
Validation auc = 0.574552
Epoch 1268
Loss = 1.0606e-01, PNorm = 126.6607, GNorm = 3.2416, lr_0 = 9.3689e-04
Loss = 3.4430e-05, PNorm = 126.6728, GNorm = 0.0012, lr_0 = 9.3687e-04
Validation auc = 0.613477
Epoch 1269
Validation auc = 0.637409
Epoch 1270
Validation auc = 0.654146
Epoch 1271
Validation auc = 0.666249
Epoch 1272
Validation auc = 0.672246
Epoch 1273
Loss = 7.8216e-03, PNorm = 126.8433, GNorm = 0.1366, lr_0 = 9.3664e-04
Loss = 1.3663e-03, PNorm = 126.8520, GNorm = 0.0482, lr_0 = 9.3662e-04
Validation auc = 0.676062
Epoch 1274
Validation auc = 0.680041
Epoch 1275
Validation auc = 0.681731
Epoch 1276
Validation auc = 0.683694
Epoch 1277
Validation auc = 0.681023
Epoch 1278
Loss = 3.2470e-01, PNorm = 126.9707, GNorm = 5.2805, lr_0 = 9.3641e-04
Validation auc = 0.663087
Epoch 1279
Validation auc = 0.649730
Epoch 1280
Validation auc = 0.638936
Epoch 1281
Validation auc = 0.641771
Epoch 1282
Validation auc = 0.637955
Epoch 1283
Loss = 2.2242e-03, PNorm = 127.2192, GNorm = 0.0744, lr_0 = 9.3616e-04
Validation auc = 0.629995
Epoch 1284
Validation auc = 0.626288
Epoch 1285
Validation auc = 0.625361
Epoch 1286
Validation auc = 0.624980
Epoch 1287
Loss = 5.4394e-03, PNorm = 127.3385, GNorm = 0.0704, lr_0 = 9.3594e-04
Loss = 3.7149e-03, PNorm = 127.3440, GNorm = 0.1039, lr_0 = 9.3592e-04
Validation auc = 0.625416
Epoch 1288
Validation auc = 0.625198
Epoch 1289
Validation auc = 0.624871
Epoch 1290
Validation auc = 0.624598
Epoch 1291
Validation auc = 0.624598
Epoch 1292
Loss = 1.0599e-01, PNorm = 127.3890, GNorm = 1.1968, lr_0 = 9.3571e-04
Validation auc = 0.622417
Epoch 1293
Validation auc = 0.624925
Epoch 1294
Validation auc = 0.628687
Epoch 1295
Validation auc = 0.631140
Epoch 1296
Validation auc = 0.631903
Epoch 1297
Loss = 2.7511e-03, PNorm = 127.4477, GNorm = 0.0483, lr_0 = 9.3546e-04
Validation auc = 0.633539
Epoch 1298
Validation auc = 0.633648
Epoch 1299
Validation auc = 0.635283
Epoch 1300
Validation auc = 0.635665
Epoch 1301
Loss = 1.8143e-03, PNorm = 127.4921, GNorm = 0.0526, lr_0 = 9.3524e-04
Loss = 4.2046e-04, PNorm = 127.4950, GNorm = 0.0170, lr_0 = 9.3523e-04
Validation auc = 0.636919
Epoch 1302
Validation auc = 0.638282
Epoch 1303
Validation auc = 0.639481
Epoch 1304
Validation auc = 0.639590
Epoch 1305
Validation auc = 0.641716
Epoch 1306
Loss = 2.7484e-03, PNorm = 127.5369, GNorm = 0.0406, lr_0 = 9.3499e-04
Loss = 8.2066e-03, PNorm = 127.5450, GNorm = 0.3670, lr_0 = 9.3498e-04
Validation auc = 0.639808
Epoch 1307
Validation auc = 0.640408
Epoch 1308
Validation auc = 0.644933
Epoch 1309
Validation auc = 0.647277
Epoch 1310
Validation auc = 0.645968
Epoch 1311
Loss = 1.4758e-02, PNorm = 127.6748, GNorm = 0.2115, lr_0 = 9.3476e-04
Validation auc = 0.645914
Epoch 1312
Validation auc = 0.644060
Epoch 1313
Validation auc = 0.642970
Epoch 1314
Validation auc = 0.642479
Epoch 1315
Validation auc = 0.642861
Epoch 1316
Loss = 8.7287e-03, PNorm = 127.7502, GNorm = 0.3778, lr_0 = 9.3451e-04
Validation auc = 0.643243
Epoch 1317
Validation auc = 0.642970
Epoch 1318
Validation auc = 0.642370
Epoch 1319
Validation auc = 0.642534
Epoch 1320
Loss = 6.0063e-04, PNorm = 127.7739, GNorm = 0.0069, lr_0 = 9.3430e-04
Loss = 2.0001e-04, PNorm = 127.7749, GNorm = 0.0053, lr_0 = 9.3428e-04
Validation auc = 0.642152
Epoch 1321
Validation auc = 0.642316
Epoch 1322
Validation auc = 0.642207
Epoch 1323
Validation auc = 0.642588
Epoch 1324
Validation auc = 0.643297
Epoch 1325
Loss = 1.5239e-03, PNorm = 127.7833, GNorm = 0.0232, lr_0 = 9.3407e-04
Validation auc = 0.643842
Epoch 1326
Validation auc = 0.643679
Epoch 1327
Validation auc = 0.642697
Epoch 1328
Validation auc = 0.642861
Epoch 1329
Validation auc = 0.642643
Epoch 1330
Loss = 1.3164e-03, PNorm = 127.7932, GNorm = 0.0202, lr_0 = 9.3382e-04
Validation auc = 0.642588
Epoch 1331
Validation auc = 0.642643
Epoch 1332
Validation auc = 0.642643
Epoch 1333
Validation auc = 0.642425
Epoch 1334
Loss = 7.8502e-04, PNorm = 127.7997, GNorm = 0.0211, lr_0 = 9.3360e-04
Loss = 5.7489e-05, PNorm = 127.8001, GNorm = 0.0017, lr_0 = 9.3359e-04
Validation auc = 0.643134
Epoch 1335
Validation auc = 0.643243
Epoch 1336
Validation auc = 0.643842
Epoch 1337
Validation auc = 0.644060
Epoch 1338
Validation auc = 0.644169
Epoch 1339
Loss = 3.7637e-04, PNorm = 127.8051, GNorm = 0.0028, lr_0 = 9.3336e-04
Loss = 1.4615e-03, PNorm = 127.8055, GNorm = 0.0836, lr_0 = 9.3334e-04
Validation auc = 0.643515
Epoch 1340
Validation auc = 0.643025
Epoch 1341
Validation auc = 0.643243
Epoch 1342
Validation auc = 0.643243
Epoch 1343
Validation auc = 0.643406
Epoch 1344
Loss = 6.4442e-04, PNorm = 127.8100, GNorm = 0.0084, lr_0 = 9.3312e-04
Validation auc = 0.643461
Epoch 1345
Validation auc = 0.643352
Epoch 1346
Validation auc = 0.643624
Epoch 1347
Validation auc = 0.645478
Epoch 1348
Validation auc = 0.645914
Epoch 1349
Loss = 1.8639e-04, PNorm = 127.8146, GNorm = 0.0036, lr_0 = 9.3288e-04
Validation auc = 0.646459
Epoch 1350
Validation auc = 0.646514
Epoch 1351
Validation auc = 0.646841
Epoch 1352
Validation auc = 0.647277
Epoch 1353
Loss = 1.3657e-02, PNorm = 127.8207, GNorm = 0.0035, lr_0 = 9.3266e-04
Loss = 2.7682e-04, PNorm = 127.8214, GNorm = 0.0084, lr_0 = 9.3264e-04
Validation auc = 0.646813
Epoch 1354
Validation auc = 0.653792
Epoch 1355
Validation auc = 0.663359
Epoch 1356
Validation auc = 0.674535
Epoch 1357
Validation auc = 0.678897
Epoch 1358
Loss = 6.6845e-03, PNorm = 127.9214, GNorm = 0.1507, lr_0 = 9.3241e-04
Validation auc = 0.681159
Epoch 1359
Validation auc = 0.682358
Epoch 1360
Validation auc = 0.683612
Epoch 1361
Validation auc = 0.685002
Epoch 1362
Validation auc = 0.686284
Epoch 1363
Loss = 1.3680e-02, PNorm = 128.0135, GNorm = 0.6865, lr_0 = 9.3218e-04
Validation auc = 0.688083
Epoch 1364
Validation auc = 0.684594
Epoch 1365
Validation auc = 0.670092
Epoch 1366
Validation auc = 0.661506
Epoch 1367
Loss = 1.0574e-03, PNorm = 128.1155, GNorm = 0.0106, lr_0 = 9.3197e-04
Loss = 8.9037e-04, PNorm = 128.1235, GNorm = 0.0385, lr_0 = 9.3195e-04
Validation auc = 0.654201
Epoch 1368
Validation auc = 0.653982
Epoch 1369
Validation auc = 0.659052
Epoch 1370
Validation auc = 0.661179
Epoch 1371
Validation auc = 0.663523
Epoch 1372
Loss = 1.5447e-03, PNorm = 128.2211, GNorm = 0.0270, lr_0 = 9.3172e-04
Loss = 1.6608e-04, PNorm = 128.2264, GNorm = 0.0064, lr_0 = 9.3170e-04
Validation auc = 0.664777
Epoch 1373
Validation auc = 0.663577
Epoch 1374
Validation auc = 0.661397
Epoch 1375
Validation auc = 0.661015
Epoch 1376
Validation auc = 0.660252
Epoch 1377
Loss = 3.4191e-02, PNorm = 128.2773, GNorm = 0.3330, lr_0 = 9.3149e-04
Validation auc = 0.660252
Epoch 1378
Validation auc = 0.659216
Epoch 1379
Validation auc = 0.659380
Epoch 1380
Validation auc = 0.660306
Epoch 1381
Validation auc = 0.660524
Epoch 1382
Loss = 5.8553e-04, PNorm = 128.3006, GNorm = 0.0113, lr_0 = 9.3124e-04
Validation auc = 0.661342
Epoch 1383
Validation auc = 0.661669
Epoch 1384
Validation auc = 0.661833
Epoch 1385
Validation auc = 0.662651
Epoch 1386
Loss = 7.9209e-03, PNorm = 128.3118, GNorm = 0.4131, lr_0 = 9.3102e-04
Loss = 4.4282e-05, PNorm = 128.3123, GNorm = 0.0016, lr_0 = 9.3101e-04
Validation auc = 0.660252
Epoch 1387
Validation auc = 0.658834
Epoch 1388
Validation auc = 0.656327
Epoch 1389
Validation auc = 0.654964
Epoch 1390
Validation auc = 0.653982
Epoch 1391
Loss = 1.4713e-03, PNorm = 128.3286, GNorm = 0.0089, lr_0 = 9.3078e-04
Validation auc = 0.653819
Epoch 1392
Validation auc = 0.653819
Epoch 1393
Validation auc = 0.653492
Epoch 1394
Validation auc = 0.650766
Epoch 1395
Validation auc = 0.646296
Epoch 1396
Loss = 1.7315e-03, PNorm = 128.3483, GNorm = 0.0594, lr_0 = 9.3055e-04
Validation auc = 0.641253
Epoch 1397
Validation auc = 0.636019
Epoch 1398
Validation auc = 0.656517
Epoch 1399
Validation auc = 0.668538
Epoch 1400
Loss = 1.4211e-03, PNorm = 128.4316, GNorm = 0.0266, lr_0 = 9.3033e-04
Loss = 5.6383e-04, PNorm = 128.4392, GNorm = 0.0169, lr_0 = 9.3032e-04
Validation auc = 0.673554
Epoch 1401
Validation auc = 0.677425
Epoch 1402
Validation auc = 0.677316
Epoch 1403
Validation auc = 0.680150
Epoch 1404
Validation auc = 0.682168
Epoch 1405
Loss = 4.5348e-04, PNorm = 128.5100, GNorm = 0.0048, lr_0 = 9.3008e-04
Loss = 3.4508e-04, PNorm = 128.5130, GNorm = 0.0096, lr_0 = 9.3007e-04
Validation auc = 0.683967
Epoch 1406
Validation auc = 0.684130
Epoch 1407
Validation auc = 0.684348
Epoch 1408
Validation auc = 0.684457
Epoch 1409
Validation auc = 0.684839
Epoch 1410
Loss = 4.2683e-04, PNorm = 128.5380, GNorm = 0.0216, lr_0 = 9.2985e-04
Validation auc = 0.684403
Epoch 1411
Validation auc = 0.679387
Epoch 1412
Validation auc = 0.676934
Epoch 1413
Validation auc = 0.675544
Epoch 1414
Validation auc = 0.677261
Epoch 1415
Loss = 8.3380e-02, PNorm = 128.6245, GNorm = 0.9552, lr_0 = 9.2961e-04
Validation auc = 0.679442
Epoch 1416
Validation auc = 0.682222
Epoch 1417
Validation auc = 0.685738
Epoch 1418
Validation auc = 0.691354
Epoch 1419
Loss = 3.5664e-03, PNorm = 128.7309, GNorm = 0.1599, lr_0 = 9.2939e-04
Loss = 1.8436e-03, PNorm = 128.7391, GNorm = 0.0563, lr_0 = 9.2938e-04
Validation auc = 0.693289
Epoch 1420
Validation auc = 0.696996
Epoch 1421
Validation auc = 0.700213
Epoch 1422
Validation auc = 0.700921
Epoch 1423
Validation auc = 0.699995
Epoch 1424
Loss = 6.8086e-03, PNorm = 128.8022, GNorm = 0.2739, lr_0 = 9.2914e-04
Validation auc = 0.700213
Epoch 1425
Validation auc = 0.702066
Epoch 1426
Validation auc = 0.704438
Epoch 1427
Validation auc = 0.706973
Epoch 1428
Validation auc = 0.708881
Epoch 1429
Loss = 5.4951e-04, PNorm = 128.8357, GNorm = 0.0105, lr_0 = 9.2891e-04
Validation auc = 0.712697
Epoch 1430
Validation auc = 0.712642
Epoch 1431
Validation auc = 0.710571
Epoch 1432
Validation auc = 0.708336
Epoch 1433
Loss = 1.6103e-03, PNorm = 128.8781, GNorm = 0.0621, lr_0 = 9.2868e-04
Validation auc = 0.707191
Epoch 1434
Validation auc = 0.703211
Epoch 1435
Validation auc = 0.692144
Epoch 1436
Validation auc = 0.687674
Epoch 1437
Validation auc = 0.685221
Epoch 1438
Loss = 7.7126e-03, PNorm = 128.9153, GNorm = 0.7022, lr_0 = 9.2845e-04
Loss = 1.4543e-04, PNorm = 128.9182, GNorm = 0.0068, lr_0 = 9.2844e-04
Validation auc = 0.684839
Epoch 1439
Validation auc = 0.686093
Epoch 1440
Validation auc = 0.686692
Epoch 1441
Validation auc = 0.687783
Epoch 1442
Validation auc = 0.689200
Epoch 1443
Loss = 5.5826e-04, PNorm = 128.9497, GNorm = 0.0124, lr_0 = 9.2822e-04
Validation auc = 0.690127
Epoch 1444
Validation auc = 0.690563
Epoch 1445
Validation auc = 0.691163
Epoch 1446
Validation auc = 0.691763
Epoch 1447
Validation auc = 0.691708
Epoch 1448
Loss = 5.1678e-03, PNorm = 128.9576, GNorm = 0.2622, lr_0 = 9.2798e-04
Validation auc = 0.692635
Epoch 1449
Validation auc = 0.693016
Epoch 1450
Validation auc = 0.694270
Epoch 1451
Validation auc = 0.693562
Epoch 1452
Loss = 1.6222e-03, PNorm = 128.9654, GNorm = 0.0265, lr_0 = 9.2776e-04
Loss = 1.8612e-04, PNorm = 128.9665, GNorm = 0.0062, lr_0 = 9.2775e-04
Validation auc = 0.693071
Epoch 1453
Validation auc = 0.693562
Epoch 1454
Validation auc = 0.691490
Epoch 1455
Validation auc = 0.691435
Epoch 1456
Validation auc = 0.691981
Epoch 1457
Loss = 1.9505e-03, PNorm = 128.9954, GNorm = 0.0095, lr_0 = 9.2752e-04
Loss = 5.2912e-04, PNorm = 128.9975, GNorm = 0.0211, lr_0 = 9.2750e-04
Validation auc = 0.692035
Epoch 1458
Validation auc = 0.692935
Epoch 1459
Validation auc = 0.693098
Epoch 1460
Validation auc = 0.693643
Epoch 1461
Validation auc = 0.694216
Epoch 1462
Loss = 7.9108e-04, PNorm = 129.0202, GNorm = 0.0154, lr_0 = 9.2729e-04
Validation auc = 0.695034
Epoch 1463
Validation auc = 0.695688
Epoch 1464
Validation auc = 0.696396
Epoch 1465
Validation auc = 0.696560
Epoch 1466
Loss = 2.8073e-04, PNorm = 129.0361, GNorm = 0.0063, lr_0 = 9.2706e-04
Validation auc = 0.696696
Epoch 1467
Validation auc = 0.696996
Epoch 1468
Validation auc = 0.697214
Epoch 1469
Validation auc = 0.696996
Epoch 1470
Validation auc = 0.696287
Epoch 1471
Loss = 3.5129e-04, PNorm = 129.0408, GNorm = 0.0072, lr_0 = 9.2683e-04
Loss = 1.7356e-04, PNorm = 129.0413, GNorm = 0.0046, lr_0 = 9.2681e-04
Validation auc = 0.695252
Epoch 1472
Validation auc = 0.694516
Epoch 1473
Validation auc = 0.694189
Epoch 1474
Validation auc = 0.693125
Epoch 1475
Validation auc = 0.692717
Epoch 1476
Loss = 3.3638e-04, PNorm = 129.0451, GNorm = 0.0068, lr_0 = 9.2660e-04
Validation auc = 0.691653
Epoch 1477
Validation auc = 0.691081
Epoch 1478
Validation auc = 0.691217
Epoch 1479
Validation auc = 0.691517
Epoch 1480
Validation auc = 0.691844
Epoch 1481
Loss = 4.3847e-04, PNorm = 129.0582, GNorm = 0.0244, lr_0 = 9.2635e-04
Validation auc = 0.692280
Epoch 1482
Validation auc = 0.692335
Epoch 1483
Validation auc = 0.692717
Epoch 1484
Validation auc = 0.690536
Epoch 1485
Loss = 8.9648e-03, PNorm = 129.0667, GNorm = 0.4481, lr_0 = 9.2614e-04
Loss = 1.0059e-04, PNorm = 129.0673, GNorm = 0.0029, lr_0 = 9.2612e-04
Validation auc = 0.688764
Epoch 1486
Validation auc = 0.686965
Epoch 1487
Validation auc = 0.689282
Epoch 1488
Validation auc = 0.692580
Epoch 1489
Validation auc = 0.695279
Epoch 1490
Loss = 7.8330e-04, PNorm = 129.0938, GNorm = 0.0085, lr_0 = 9.2589e-04
Loss = 3.2385e-06, PNorm = 129.0955, GNorm = 0.0002, lr_0 = 9.2587e-04
Validation auc = 0.696287
Epoch 1491
Validation auc = 0.696860
Epoch 1492
Validation auc = 0.697569
Epoch 1493
Validation auc = 0.698305
Epoch 1494
Validation auc = 0.698686
Epoch 1495
Loss = 2.1527e-04, PNorm = 129.1112, GNorm = 0.0035, lr_0 = 9.2566e-04
Validation auc = 0.699013
Epoch 1496
Validation auc = 0.699150
Epoch 1497
Validation auc = 0.699313
Epoch 1498
Validation auc = 0.699586
Epoch 1499
Loss = 5.8304e-03, PNorm = 129.1159, GNorm = 0.0136, lr_0 = 9.2543e-04
Validation auc = 0.699368
Epoch 1500
Validation auc = 0.698414
Epoch 1501
Validation auc = 0.698086
Epoch 1502
Validation auc = 0.697868
Epoch 1503
Validation auc = 0.698305
Epoch 1504
Loss = 7.2897e-04, PNorm = 129.1270, GNorm = 0.0094, lr_0 = 9.2520e-04
Loss = 8.1127e-04, PNorm = 129.1287, GNorm = 0.0425, lr_0 = 9.2518e-04
Validation auc = 0.699286
Epoch 1505
Validation auc = 0.699804
Epoch 1506
Validation auc = 0.700185
Epoch 1507
Validation auc = 0.700213
Epoch 1508
Validation auc = 0.700485
Epoch 1509
Loss = 1.4074e-04, PNorm = 129.1444, GNorm = 0.0024, lr_0 = 9.2497e-04
Validation auc = 0.700703
Epoch 1510
Validation auc = 0.700867
Epoch 1511
Validation auc = 0.701030
Epoch 1512
Validation auc = 0.700921
Epoch 1513
Validation auc = 0.701303
Epoch 1514
Loss = 1.5420e-04, PNorm = 129.1539, GNorm = 0.0029, lr_0 = 9.2472e-04
Validation auc = 0.701330
Epoch 1515
Validation auc = 0.700322
Epoch 1516
Validation auc = 0.700022
Epoch 1517
Validation auc = 0.700594
Epoch 1518
Loss = 8.9579e-04, PNorm = 129.1624, GNorm = 0.0039, lr_0 = 9.2451e-04
Loss = 5.2904e-05, PNorm = 129.1632, GNorm = 0.0019, lr_0 = 9.2449e-04
Validation auc = 0.700785
Epoch 1519
Validation auc = 0.700594
Epoch 1520
Validation auc = 0.700949
Epoch 1521
Validation auc = 0.700621
Epoch 1522
Validation auc = 0.701303
Epoch 1523
Loss = 4.3158e-04, PNorm = 129.1791, GNorm = 0.0165, lr_0 = 9.2427e-04
Loss = 1.1384e-05, PNorm = 129.1803, GNorm = 0.0006, lr_0 = 9.2425e-04
Validation auc = 0.702421
Epoch 1524
Validation auc = 0.704301
Epoch 1525
Validation auc = 0.707382
Epoch 1526
Validation auc = 0.705010
Epoch 1527
Validation auc = 0.706537
Epoch 1528
Loss = 1.2393e-04, PNorm = 129.2193, GNorm = 0.0028, lr_0 = 9.2404e-04
Validation auc = 0.704956
Epoch 1529
Validation auc = 0.706073
Epoch 1530
Validation auc = 0.706346
Epoch 1531
Validation auc = 0.707627
Epoch 1532
Validation auc = 0.709208
Epoch 1533
Loss = 3.1094e-04, PNorm = 129.3175, GNorm = 0.0059, lr_0 = 9.2379e-04
Validation auc = 0.710489
Epoch 1534
Validation auc = 0.711961
Epoch 1535
Validation auc = 0.713188
Epoch 1536
Validation auc = 0.714114
Epoch 1537
Loss = 1.7861e-03, PNorm = 129.3510, GNorm = 0.0805, lr_0 = 9.2358e-04
Loss = 1.5805e-04, PNorm = 129.3528, GNorm = 0.0052, lr_0 = 9.2356e-04
Validation auc = 0.714332
Epoch 1538
Validation auc = 0.714441
Epoch 1539
Validation auc = 0.715832
Epoch 1540
Validation auc = 0.716867
Epoch 1541
Validation auc = 0.718285
Epoch 1542
Loss = 3.3323e-03, PNorm = 129.3695, GNorm = 0.1014, lr_0 = 9.2335e-04
Validation auc = 0.718939
Epoch 1543
Validation auc = 0.719157
Epoch 1544
Validation auc = 0.719048
Epoch 1545
Validation auc = 0.719321
Epoch 1546
Validation auc = 0.719321
Epoch 1547
Loss = 8.9018e-05, PNorm = 129.3791, GNorm = 0.0019, lr_0 = 9.2310e-04
Validation auc = 0.719212
Epoch 1548
Validation auc = 0.719430
Epoch 1549
Validation auc = 0.719484
Epoch 1550
Validation auc = 0.719784
Epoch 1551
Loss = 1.2653e-04, PNorm = 129.3838, GNorm = 0.0020, lr_0 = 9.2289e-04
Loss = 2.1434e-02, PNorm = 129.3857, GNorm = 0.7580, lr_0 = 9.2287e-04
Validation auc = 0.720820
Epoch 1552
Validation auc = 0.724118
Epoch 1553
Validation auc = 0.726026
Epoch 1554
Validation auc = 0.727444
Epoch 1555
Validation auc = 0.727825
Epoch 1556
Loss = 1.2608e-04, PNorm = 129.4095, GNorm = 0.0032, lr_0 = 9.2264e-04
Loss = 1.3420e-04, PNorm = 129.4106, GNorm = 0.0036, lr_0 = 9.2263e-04
Validation auc = 0.728916
Epoch 1557
Validation auc = 0.729297
Epoch 1558
Validation auc = 0.729406
Epoch 1559
Validation auc = 0.729624
Epoch 1560
Validation auc = 0.729870
Epoch 1561
Loss = 8.2236e-05, PNorm = 129.4195, GNorm = 0.0019, lr_0 = 9.2242e-04
Validation auc = 0.730088
Epoch 1562
Validation auc = 0.730197
Epoch 1563
Validation auc = 0.730469
Epoch 1564
Validation auc = 0.730742
Epoch 1565
Validation auc = 0.729543
Epoch 1566
Loss = 8.1033e-05, PNorm = 129.4246, GNorm = 0.0015, lr_0 = 9.2217e-04
Validation auc = 0.728398
Epoch 1567
Validation auc = 0.727716
Epoch 1568
Validation auc = 0.727525
Epoch 1569
Validation auc = 0.727253
Epoch 1570
Loss = 2.2866e-04, PNorm = 129.4275, GNorm = 0.0009, lr_0 = 9.2196e-04
Loss = 1.8417e-05, PNorm = 129.4277, GNorm = 0.0008, lr_0 = 9.2194e-04
Validation auc = 0.726980
Epoch 1571
Validation auc = 0.726926
Epoch 1572
Validation auc = 0.726708
Epoch 1573
Validation auc = 0.726163
Epoch 1574
Validation auc = 0.725726
Epoch 1575
Loss = 1.3198e-04, PNorm = 129.4301, GNorm = 0.0023, lr_0 = 9.2173e-04
Validation auc = 0.725590
Epoch 1576
Validation auc = 0.725481
Epoch 1577
Validation auc = 0.725427
Epoch 1578
Validation auc = 0.725427
Epoch 1579
Validation auc = 0.725427
Epoch 1580
Loss = 9.8165e-05, PNorm = 129.4329, GNorm = 0.0017, lr_0 = 9.2148e-04
Validation auc = 0.725481
Epoch 1581
Validation auc = 0.725481
Epoch 1582
Validation auc = 0.725699
Epoch 1583
Validation auc = 0.725699
Epoch 1584
Loss = 6.0050e-05, PNorm = 129.4365, GNorm = 0.0013, lr_0 = 9.2127e-04
Loss = 1.7291e-04, PNorm = 129.4369, GNorm = 0.0042, lr_0 = 9.2125e-04
Validation auc = 0.726026
Epoch 1585
Validation auc = 0.726135
Epoch 1586
Validation auc = 0.726299
Epoch 1587
Validation auc = 0.726244
Epoch 1588
Validation auc = 0.726244
Epoch 1589
Loss = 6.5095e-05, PNorm = 129.4410, GNorm = 0.0006, lr_0 = 9.2103e-04
Loss = 7.6813e-05, PNorm = 129.4413, GNorm = 0.0034, lr_0 = 9.2101e-04
Validation auc = 0.726244
Epoch 1590
Validation auc = 0.725536
Epoch 1591
Validation auc = 0.725181
Epoch 1592
Validation auc = 0.724527
Epoch 1593
Validation auc = 0.724200
Epoch 1594
Loss = 4.5748e-05, PNorm = 129.4439, GNorm = 0.0009, lr_0 = 9.2080e-04
Validation auc = 0.724036
Epoch 1595
Validation auc = 0.723573
Epoch 1596
Validation auc = 0.723137
Epoch 1597
Validation auc = 0.722755
Epoch 1598
Validation auc = 0.722455
Epoch 1599
Loss = 1.1866e-04, PNorm = 129.4470, GNorm = 0.0023, lr_0 = 9.2055e-04
Validation auc = 0.722074
Epoch 1600
Validation auc = 0.721692
Epoch 1601
Validation auc = 0.721529
Epoch 1602
Validation auc = 0.721311
Epoch 1603
Loss = 1.0972e-04, PNorm = 129.4514, GNorm = 0.0058, lr_0 = 9.2034e-04
Loss = 4.1026e-05, PNorm = 129.4517, GNorm = 0.0014, lr_0 = 9.2032e-04
Validation auc = 0.721365
Epoch 1604
Validation auc = 0.721338
Epoch 1605
Validation auc = 0.721365
Epoch 1606
Validation auc = 0.721365
Epoch 1607
Validation auc = 0.721420
Epoch 1608
Loss = 1.0920e-04, PNorm = 129.4560, GNorm = 0.0073, lr_0 = 9.2010e-04
Validation auc = 0.721311
Epoch 1609
Validation auc = 0.721256
Epoch 1610
Validation auc = 0.721365
Epoch 1611
Validation auc = 0.721365
Epoch 1612
Validation auc = 0.721365
Epoch 1613
Loss = 6.3989e-05, PNorm = 129.4601, GNorm = 0.0025, lr_0 = 9.1987e-04
Validation auc = 0.721365
Epoch 1614
Validation auc = 0.721638
Epoch 1615
Validation auc = 0.721747
Epoch 1616
Validation auc = 0.721801
Epoch 1617
Loss = 5.7445e-05, PNorm = 129.4634, GNorm = 0.0008, lr_0 = 9.1966e-04
Loss = 1.7424e-05, PNorm = 129.4636, GNorm = 0.0012, lr_0 = 9.1964e-04
Validation auc = 0.721801
Epoch 1618
Validation auc = 0.721747
Epoch 1619
Validation auc = 0.721747
Epoch 1620
Validation auc = 0.721801
Epoch 1621
Validation auc = 0.721828
Epoch 1622
Loss = 5.1129e-05, PNorm = 129.4668, GNorm = 0.0021, lr_0 = 9.1941e-04
Loss = 9.8796e-05, PNorm = 129.4671, GNorm = 0.0033, lr_0 = 9.1939e-04
Validation auc = 0.722047
Epoch 1623
Validation auc = 0.722156
Epoch 1624
Validation auc = 0.721174
Epoch 1625
Validation auc = 0.720275
Epoch 1626
Validation auc = 0.719730
Epoch 1627
Loss = 3.8801e-05, PNorm = 129.4701, GNorm = 0.0011, lr_0 = 9.1918e-04
Validation auc = 0.719566
Epoch 1628
Validation auc = 0.718912
Epoch 1629
Validation auc = 0.718694
Epoch 1630
Validation auc = 0.718639
Epoch 1631
Validation auc = 0.718694
Epoch 1632
Loss = 5.8240e-05, PNorm = 129.4733, GNorm = 0.0025, lr_0 = 9.1894e-04
Validation auc = 0.718748
Epoch 1633
Validation auc = 0.718694
Epoch 1634
Validation auc = 0.718639
Epoch 1635
Validation auc = 0.718421
Epoch 1636
Loss = 4.7244e-05, PNorm = 129.4759, GNorm = 0.0007, lr_0 = 9.1873e-04
Loss = 1.4682e-05, PNorm = 129.4761, GNorm = 0.0008, lr_0 = 9.1871e-04
Validation auc = 0.718312
Epoch 1637
Validation auc = 0.718448
Epoch 1638
Validation auc = 0.718557
Epoch 1639
Validation auc = 0.718612
Epoch 1640
Validation auc = 0.718612
Epoch 1641
Loss = 2.6149e-05, PNorm = 129.4781, GNorm = 0.0005, lr_0 = 9.1848e-04
Validation auc = 0.718694
Epoch 1642
Validation auc = 0.718639
Epoch 1643
Validation auc = 0.718639
Epoch 1644
Validation auc = 0.718694
Epoch 1645
Validation auc = 0.718694
Epoch 1646
Loss = 2.0065e-05, PNorm = 129.4805, GNorm = 0.0006, lr_0 = 9.1825e-04
Validation auc = 0.718639
Epoch 1647
Validation auc = 0.718612
Epoch 1648
Validation auc = 0.718694
Epoch 1649
Validation auc = 0.718694
Epoch 1650
Loss = 2.7246e-05, PNorm = 129.4828, GNorm = 0.0007, lr_0 = 9.1804e-04
Loss = 5.5432e-06, PNorm = 129.4829, GNorm = 0.0002, lr_0 = 9.1803e-04
Validation auc = 0.718803
Epoch 1651
Validation auc = 0.718803
Epoch 1652
Validation auc = 0.718803
Epoch 1653
Validation auc = 0.719075
Epoch 1654
Validation auc = 0.719103
Epoch 1655
Loss = 3.4001e-05, PNorm = 129.4850, GNorm = 0.0011, lr_0 = 9.1780e-04
Loss = 5.0663e-06, PNorm = 129.4851, GNorm = 0.0002, lr_0 = 9.1778e-04
Validation auc = 0.718994
Epoch 1656
Validation auc = 0.719212
Epoch 1657
Validation auc = 0.719593
Epoch 1658
Validation auc = 0.719593
Epoch 1659
Validation auc = 0.719702
Epoch 1660
Loss = 2.1438e-05, PNorm = 129.4855, GNorm = 0.0004, lr_0 = 9.1757e-04
Validation auc = 0.719757
Epoch 1661
Validation auc = 0.719757
Epoch 1662
Validation auc = 0.719866
Epoch 1663
Validation auc = 0.719920
Epoch 1664
Validation auc = 0.719757
Epoch 1665
Loss = 1.5303e-05, PNorm = 129.4870, GNorm = 0.0004, lr_0 = 9.1733e-04
Validation auc = 0.719866
Epoch 1666
Validation auc = 0.719811
Epoch 1667
Validation auc = 0.719866
Epoch 1668
Validation auc = 0.720057
Epoch 1669
Loss = 5.2629e-04, PNorm = 129.4882, GNorm = 0.0003, lr_0 = 9.1712e-04
Loss = 3.5165e-05, PNorm = 129.4885, GNorm = 0.0013, lr_0 = 9.1710e-04
Validation auc = 0.719212
Epoch 1670
Validation auc = 0.718421
Epoch 1671
Validation auc = 0.717603
Epoch 1672
Validation auc = 0.717167
Epoch 1673
Validation auc = 0.716131
Epoch 1674
Loss = 7.8029e-04, PNorm = 129.4993, GNorm = 0.0029, lr_0 = 9.1687e-04
Validation auc = 0.717358
Epoch 1675
Validation auc = 0.718067
Epoch 1676
Validation auc = 0.719048
Epoch 1677
Validation auc = 0.718939
Epoch 1678
Validation auc = 0.719920
Epoch 1679
Loss = 6.8645e-05, PNorm = 129.5207, GNorm = 0.0015, lr_0 = 9.1664e-04
Validation auc = 0.720029
Epoch 1680
Validation auc = 0.720466
Epoch 1681
Validation auc = 0.720684
Epoch 1682
Validation auc = 0.721011
Epoch 1683
Loss = 5.6327e-05, PNorm = 129.5342, GNorm = 0.0024, lr_0 = 9.1642e-04
Validation auc = 0.721365
Epoch 1684
Validation auc = 0.721474
Epoch 1685
Validation auc = 0.721529
Epoch 1686
Validation auc = 0.721256
Epoch 1687
Validation auc = 0.721202
Epoch 1688
Loss = 2.2379e-05, PNorm = 129.5398, GNorm = 0.0007, lr_0 = 9.1619e-04
Loss = 2.5370e-05, PNorm = 129.5400, GNorm = 0.0013, lr_0 = 9.1617e-04
Validation auc = 0.721256
Epoch 1689
Validation auc = 0.721093
Epoch 1690
Validation auc = 0.721147
Epoch 1691
Validation auc = 0.721093
Epoch 1692
Validation auc = 0.721202
Epoch 1693
Loss = 1.3732e-05, PNorm = 129.5427, GNorm = 0.0003, lr_0 = 9.1596e-04
Validation auc = 0.721038
Epoch 1694
Validation auc = 0.720929
Epoch 1695
Validation auc = 0.721093
Epoch 1696
Validation auc = 0.721256
Epoch 1697
Validation auc = 0.721365
Epoch 1698
Loss = 7.8432e-05, PNorm = 129.5451, GNorm = 0.0056, lr_0 = 9.1572e-04
Validation auc = 0.721420
Epoch 1699
Validation auc = 0.721474
Epoch 1700
Validation auc = 0.721420
Epoch 1701
Validation auc = 0.721474
Epoch 1702
Loss = 4.4031e-05, PNorm = 129.5467, GNorm = 0.0028, lr_0 = 9.1551e-04
Loss = 2.9740e-05, PNorm = 129.5468, GNorm = 0.0013, lr_0 = 9.1549e-04
Validation auc = 0.721420
Epoch 1703
Validation auc = 0.719920
Epoch 1704
Validation auc = 0.719402
Epoch 1705
Validation auc = 0.718421
Epoch 1706
Validation auc = 0.718067
Epoch 1707
Loss = 3.2409e-05, PNorm = 129.5472, GNorm = 0.0005, lr_0 = 9.1526e-04
Loss = 1.6046e-04, PNorm = 129.5474, GNorm = 0.0087, lr_0 = 9.1525e-04
Validation auc = 0.717685
Epoch 1708
Validation auc = 0.717467
Epoch 1709
Validation auc = 0.717413
Epoch 1710
Validation auc = 0.717794
Epoch 1711
Validation auc = 0.717849
Epoch 1712
Loss = 2.0779e-05, PNorm = 129.5498, GNorm = 0.0006, lr_0 = 9.1504e-04
Validation auc = 0.717822
Epoch 1713
Validation auc = 0.717549
Epoch 1714
Validation auc = 0.717494
Epoch 1715
Validation auc = 0.717494
Epoch 1716
Loss = 2.4387e-05, PNorm = 129.5518, GNorm = 0.0015, lr_0 = 9.1481e-04
Validation auc = 0.717440
Epoch 1717
Validation auc = 0.717494
Epoch 1718
Validation auc = 0.717440
Epoch 1719
Validation auc = 0.717549
Epoch 1720
Validation auc = 0.717603
Epoch 1721
Loss = 2.5796e-05, PNorm = 129.5536, GNorm = 0.0004, lr_0 = 9.1458e-04
Loss = 1.3271e-03, PNorm = 129.5537, GNorm = 0.1104, lr_0 = 9.1457e-04
Validation auc = 0.717603
Epoch 1722
Validation auc = 0.717058
Epoch 1723
Validation auc = 0.716677
Epoch 1724
Validation auc = 0.716677
Epoch 1725
Validation auc = 0.716786
Epoch 1726
Loss = 1.9232e-05, PNorm = 129.5567, GNorm = 0.0005, lr_0 = 9.1436e-04
Validation auc = 0.717004
Epoch 1727
Validation auc = 0.717058
Epoch 1728
Validation auc = 0.717113
Epoch 1729
Validation auc = 0.717004
Epoch 1730
Validation auc = 0.717004
Epoch 1731
Loss = 1.1556e-05, PNorm = 129.5595, GNorm = 0.0003, lr_0 = 9.1411e-04
Validation auc = 0.717058
Epoch 1732
Validation auc = 0.717113
Epoch 1733
Validation auc = 0.717167
Epoch 1734
Validation auc = 0.717167
Epoch 1735
Loss = 5.8546e-04, PNorm = 129.5612, GNorm = 0.1132, lr_0 = 9.1390e-04
Loss = 2.4083e-04, PNorm = 129.5614, GNorm = 0.0097, lr_0 = 9.1389e-04
Validation auc = 0.716077
Epoch 1736
Validation auc = 0.715450
Epoch 1737
Validation auc = 0.714605
Epoch 1738
Validation auc = 0.714278
Epoch 1739
Validation auc = 0.714005
Epoch 1740
Loss = 5.7088e-05, PNorm = 129.5653, GNorm = 0.0012, lr_0 = 9.1366e-04
Loss = 1.1325e-06, PNorm = 129.5655, GNorm = 0.0000, lr_0 = 9.1364e-04
Validation auc = 0.713896
Epoch 1741
Validation auc = 0.713951
Epoch 1742
Validation auc = 0.714005
Epoch 1743
Validation auc = 0.713896
Epoch 1744
Validation auc = 0.713842
Epoch 1745
Loss = 1.5194e-05, PNorm = 129.5680, GNorm = 0.0004, lr_0 = 9.1343e-04
Validation auc = 0.713842
Epoch 1746
Validation auc = 0.713678
Epoch 1747
Validation auc = 0.713624
Epoch 1748
Validation auc = 0.713678
Epoch 1749
Loss = 1.9628e-05, PNorm = 129.5700, GNorm = 0.0003, lr_0 = 9.1320e-04
Validation auc = 0.713787
Epoch 1750
Validation auc = 0.713733
Epoch 1751
Validation auc = 0.713787
Epoch 1752
Validation auc = 0.713787
Epoch 1753
Validation auc = 0.713842
Epoch 1754
Loss = 4.0937e-05, PNorm = 129.5720, GNorm = 0.0018, lr_0 = 9.1298e-04
Loss = 7.5347e-05, PNorm = 129.5721, GNorm = 0.0033, lr_0 = 9.1296e-04
Validation auc = 0.713733
Epoch 1755
Validation auc = 0.713787
Epoch 1756
Validation auc = 0.713896
Epoch 1757
Validation auc = 0.714060
Epoch 1758
Validation auc = 0.714060
Epoch 1759
Loss = 3.9028e-06, PNorm = 129.5738, GNorm = 0.0001, lr_0 = 9.1275e-04
Validation auc = 0.714169
Epoch 1760
Validation auc = 0.714169
Epoch 1761
Validation auc = 0.714169
Epoch 1762
Validation auc = 0.714223
Epoch 1763
Validation auc = 0.714332
Epoch 1764
Loss = 2.3111e-05, PNorm = 129.5755, GNorm = 0.0007, lr_0 = 9.1251e-04
Validation auc = 0.714387
Epoch 1765
Validation auc = 0.714387
Epoch 1766
Validation auc = 0.714551
Epoch 1767
Validation auc = 0.714605
Epoch 1768
Loss = 1.5222e-05, PNorm = 129.5767, GNorm = 0.0003, lr_0 = 9.1230e-04
Loss = 2.3444e-06, PNorm = 129.5768, GNorm = 0.0001, lr_0 = 9.1228e-04
Validation auc = 0.714605
Epoch 1769
Validation auc = 0.714660
Epoch 1770
Validation auc = 0.714387
Epoch 1771
Validation auc = 0.714496
Epoch 1772
Validation auc = 0.714551
Epoch 1773
Loss = 1.5629e-05, PNorm = 129.5780, GNorm = 0.0006, lr_0 = 9.1206e-04
Loss = 9.9537e-06, PNorm = 129.5780, GNorm = 0.0005, lr_0 = 9.1204e-04
Validation auc = 0.714660
Epoch 1774
Validation auc = 0.714714
Epoch 1775
Validation auc = 0.714660
Epoch 1776
Validation auc = 0.714660
Epoch 1777
Validation auc = 0.714769
Epoch 1778
Loss = 1.6295e-05, PNorm = 129.5791, GNorm = 0.0004, lr_0 = 9.1183e-04
Validation auc = 0.714796
Epoch 1779
Validation auc = 0.714905
Epoch 1780
Validation auc = 0.715096
Epoch 1781
Validation auc = 0.715286
Epoch 1782
Validation auc = 0.715777
Epoch 1783
Loss = 4.8289e-05, PNorm = 129.5813, GNorm = 0.0019, lr_0 = 9.1159e-04
Validation auc = 0.716268
Epoch 1784
Validation auc = 0.716131
Epoch 1785
Validation auc = 0.716295
Epoch 1786
Validation auc = 0.716350
Epoch 1787
Loss = 1.9139e-04, PNorm = 129.5850, GNorm = 0.0134, lr_0 = 9.1138e-04
Loss = 1.1343e-04, PNorm = 129.5854, GNorm = 0.0049, lr_0 = 9.1136e-04
Validation auc = 0.716649
Epoch 1788
Validation auc = 0.716922
Epoch 1789
Validation auc = 0.717413
Epoch 1790
Validation auc = 0.717549
Epoch 1791
Validation auc = 0.717876
Epoch 1792
Loss = 3.2387e-05, PNorm = 129.5889, GNorm = 0.0013, lr_0 = 9.1115e-04
Validation auc = 0.718367
Epoch 1793
Validation auc = 0.718394
Epoch 1794
Validation auc = 0.718667
Epoch 1795
Validation auc = 0.718667
Epoch 1796
Validation auc = 0.718830
Epoch 1797
Loss = 1.9755e-05, PNorm = 129.5917, GNorm = 0.0006, lr_0 = 9.1091e-04
Validation auc = 0.718885
Epoch 1798
Validation auc = 0.719157
Epoch 1799
Validation auc = 0.719103
Epoch 1800
Validation auc = 0.719103
Epoch 1801
Loss = 1.3674e-05, PNorm = 129.5930, GNorm = 0.0005, lr_0 = 9.1070e-04
Loss = 7.3512e-07, PNorm = 129.5931, GNorm = 0.0000, lr_0 = 9.1068e-04
Validation auc = 0.719048
Epoch 1802
Validation auc = 0.719103
Epoch 1803
Validation auc = 0.718994
Epoch 1804
Validation auc = 0.719048
Epoch 1805
Validation auc = 0.719048
Epoch 1806
Loss = 1.2063e-05, PNorm = 129.5943, GNorm = 0.0004, lr_0 = 9.1046e-04
Loss = 2.9860e-05, PNorm = 129.5944, GNorm = 0.0012, lr_0 = 9.1044e-04
Validation auc = 0.718994
Epoch 1807
Validation auc = 0.718339
Epoch 1808
Validation auc = 0.717958
Epoch 1809
Validation auc = 0.717794
Epoch 1810
Validation auc = 0.717822
Epoch 1811
Loss = 8.7377e-06, PNorm = 129.5955, GNorm = 0.0003, lr_0 = 9.1023e-04
Validation auc = 0.717767
Epoch 1812
Validation auc = 0.717603
Epoch 1813
Validation auc = 0.717385
Epoch 1814
Validation auc = 0.717331
Epoch 1815
Validation auc = 0.717222
Epoch 1816
Loss = 1.4564e-05, PNorm = 129.5970, GNorm = 0.0005, lr_0 = 9.0999e-04
Validation auc = 0.717331
Epoch 1817
Validation auc = 0.717113
Epoch 1818
Validation auc = 0.717167
Epoch 1819
Validation auc = 0.717167
Epoch 1820
Loss = 2.6407e-05, PNorm = 129.5979, GNorm = 0.0003, lr_0 = 9.0978e-04
Loss = 1.0212e-05, PNorm = 129.5980, GNorm = 0.0004, lr_0 = 9.0976e-04
Validation auc = 0.716949
Epoch 1821
Validation auc = 0.716840
Epoch 1822
Validation auc = 0.717004
Epoch 1823
Validation auc = 0.717113
Epoch 1824
Validation auc = 0.717358
Epoch 1825
Loss = 8.5899e-06, PNorm = 129.5997, GNorm = 0.0002, lr_0 = 9.0955e-04
Validation auc = 0.717576
Epoch 1826
Validation auc = 0.717413
Epoch 1827
Validation auc = 0.717467
Epoch 1828
Validation auc = 0.717658
Epoch 1829
Validation auc = 0.718312
Epoch 1830
Loss = 4.6064e-05, PNorm = 129.6107, GNorm = 0.0014, lr_0 = 9.0931e-04
Validation auc = 0.717931
Epoch 1831
Validation auc = 0.717712
Epoch 1832
Validation auc = 0.717304
Epoch 1833
Validation auc = 0.717222
Epoch 1834
Loss = 5.2250e-05, PNorm = 129.6164, GNorm = 0.0014, lr_0 = 9.0910e-04
Loss = 2.9602e-05, PNorm = 129.6168, GNorm = 0.0008, lr_0 = 9.0909e-04
Validation auc = 0.716840
Epoch 1835
Validation auc = 0.716895
Epoch 1836
Validation auc = 0.716486
Epoch 1837
Validation auc = 0.716104
Epoch 1838
Validation auc = 0.716159
Epoch 1839
Loss = 3.5965e-05, PNorm = 129.6208, GNorm = 0.0010, lr_0 = 9.0886e-04
Loss = 2.5829e-07, PNorm = 129.6210, GNorm = 0.0000, lr_0 = 9.0884e-04
Validation auc = 0.716213
Epoch 1840
Validation auc = 0.716377
Epoch 1841
Validation auc = 0.716377
Epoch 1842
Validation auc = 0.715777
Epoch 1843
Validation auc = 0.715396
Epoch 1844
Loss = 2.1414e-05, PNorm = 129.6238, GNorm = 0.0007, lr_0 = 9.0863e-04
Validation auc = 0.715068
Epoch 1845
Validation auc = 0.715177
Epoch 1846
Validation auc = 0.714959
Epoch 1847
Validation auc = 0.714850
Epoch 1848
Validation auc = 0.714959
Epoch 1849
Loss = 2.9980e-05, PNorm = 129.6264, GNorm = 0.0010, lr_0 = 9.0839e-04
Validation auc = 0.714959
Epoch 1850
Validation auc = 0.714959
Epoch 1851
Validation auc = 0.714959
Epoch 1852
Validation auc = 0.715068
Epoch 1853
Loss = 1.7774e-05, PNorm = 129.6284, GNorm = 0.0006, lr_0 = 9.0818e-04
Loss = 8.8214e-06, PNorm = 129.6285, GNorm = 0.0004, lr_0 = 9.0817e-04
Validation auc = 0.715068
Epoch 1854
Validation auc = 0.714905
Epoch 1855
Validation auc = 0.715123
Epoch 1856
Validation auc = 0.714741
Epoch 1857
Validation auc = 0.714414
Epoch 1858
Loss = 1.4647e-05, PNorm = 129.6309, GNorm = 0.0006, lr_0 = 9.0794e-04
Validation auc = 0.714114
Epoch 1859
Validation auc = 0.713678
Epoch 1860
Validation auc = 0.713460
Epoch 1861
Validation auc = 0.713406
Epoch 1862
Validation auc = 0.713242
Epoch 1863
Loss = 1.4793e-05, PNorm = 129.6333, GNorm = 0.0004, lr_0 = 9.0772e-04
Validation auc = 0.713160
Epoch 1864
Validation auc = 0.713106
Epoch 1865
Validation auc = 0.713160
Epoch 1866
Validation auc = 0.713106
Epoch 1867
Loss = 1.4045e-05, PNorm = 129.6351, GNorm = 0.0004, lr_0 = 9.0751e-04
Loss = 7.5299e-06, PNorm = 129.6352, GNorm = 0.0004, lr_0 = 9.0749e-04
Validation auc = 0.713215
Epoch 1868
Validation auc = 0.713324
Epoch 1869
Validation auc = 0.713378
Epoch 1870
Validation auc = 0.713378
Epoch 1871
Validation auc = 0.713378
Epoch 1872
Loss = 1.2248e-05, PNorm = 129.6367, GNorm = 0.0002, lr_0 = 9.0727e-04
Loss = 1.5622e-04, PNorm = 129.6369, GNorm = 0.0060, lr_0 = 9.0725e-04
Validation auc = 0.713378
Epoch 1873
Validation auc = 0.713433
Epoch 1874
Validation auc = 0.713678
Epoch 1875
Validation auc = 0.713678
Epoch 1876
Validation auc = 0.713678
Epoch 1877
Loss = 7.8580e-06, PNorm = 129.6389, GNorm = 0.0003, lr_0 = 9.0704e-04
Validation auc = 0.713842
Epoch 1878
Validation auc = 0.713842
Epoch 1879
Validation auc = 0.713896
Epoch 1880
Validation auc = 0.713951
Epoch 1881
Validation auc = 0.714060
Epoch 1882
Loss = 7.7316e-06, PNorm = 129.6404, GNorm = 0.0002, lr_0 = 9.0680e-04
Validation auc = 0.714005
Epoch 1883
Validation auc = 0.714005
Epoch 1884
Validation auc = 0.714060
Epoch 1885
Validation auc = 0.713896
Epoch 1886
Loss = 5.1079e-06, PNorm = 129.6413, GNorm = 0.0002, lr_0 = 9.0659e-04
Loss = 2.9145e-05, PNorm = 129.6414, GNorm = 0.0009, lr_0 = 9.0657e-04
Validation auc = 0.713815
Epoch 1887
Validation auc = 0.713542
Epoch 1888
Validation auc = 0.713542
Epoch 1889
Validation auc = 0.713596
Epoch 1890
Validation auc = 0.713651
Epoch 1891
Loss = 9.3205e-06, PNorm = 129.6423, GNorm = 0.0004, lr_0 = 9.0635e-04
Validation auc = 0.713651
Epoch 1892
Validation auc = 0.713487
Epoch 1893
Validation auc = 0.713433
Epoch 1894
Validation auc = 0.713433
Epoch 1895
Validation auc = 0.713433
Epoch 1896
Loss = 9.1955e-06, PNorm = 129.6433, GNorm = 0.0002, lr_0 = 9.0612e-04
Validation auc = 0.713351
Epoch 1897
Validation auc = 0.713351
Epoch 1898
Validation auc = 0.713242
Epoch 1899
Validation auc = 0.713133
Epoch 1900
Loss = 5.8601e-06, PNorm = 129.6443, GNorm = 0.0002, lr_0 = 9.0592e-04
Loss = 5.1657e-06, PNorm = 129.6443, GNorm = 0.0003, lr_0 = 9.0590e-04
Validation auc = 0.713079
Epoch 1901
Validation auc = 0.713079
Epoch 1902
Validation auc = 0.713242
Epoch 1903
Validation auc = 0.713242
Epoch 1904
Validation auc = 0.713297
Epoch 1905
Loss = 9.8589e-06, PNorm = 129.6449, GNorm = 0.0001, lr_0 = 9.0567e-04
Loss = 2.5829e-07, PNorm = 129.6450, GNorm = 0.0000, lr_0 = 9.0566e-04
Validation auc = 0.713351
Epoch 1906
Validation auc = 0.713297
Epoch 1907
Validation auc = 0.713242
Epoch 1908
Validation auc = 0.713297
Epoch 1909
Validation auc = 0.713242
Epoch 1910
Loss = 5.4573e-06, PNorm = 129.6457, GNorm = 0.0001, lr_0 = 9.0545e-04
Validation auc = 0.713351
Epoch 1911
Validation auc = 0.713515
Epoch 1912
Validation auc = 0.713733
Epoch 1913
Validation auc = 0.713842
Epoch 1914
Validation auc = 0.713951
Epoch 1915
Loss = 1.2206e-05, PNorm = 129.6463, GNorm = 0.0004, lr_0 = 9.0521e-04
Validation auc = 0.714060
Epoch 1916
Validation auc = 0.714005
Epoch 1917
Validation auc = 0.713951
Epoch 1918
Validation auc = 0.713896
Epoch 1919
Loss = 8.0292e-06, PNorm = 129.6470, GNorm = 0.0001, lr_0 = 9.0500e-04
Loss = 2.5829e-07, PNorm = 129.6471, GNorm = 0.0000, lr_0 = 9.0498e-04
Validation auc = 0.713896
Epoch 1920
Validation auc = 0.713896
Epoch 1921
Validation auc = 0.713896
Epoch 1922
Validation auc = 0.713896
Epoch 1923
Validation auc = 0.713787
Epoch 1924
Loss = 5.8863e-06, PNorm = 129.6478, GNorm = 0.0002, lr_0 = 9.0476e-04
Validation auc = 0.713760
Epoch 1925
Validation auc = 0.713760
Epoch 1926
Validation auc = 0.713706
Epoch 1927
Validation auc = 0.713651
Epoch 1928
Validation auc = 0.713651
Epoch 1929
Loss = 7.4623e-06, PNorm = 129.6485, GNorm = 0.0002, lr_0 = 9.0454e-04
Validation auc = 0.713760
Epoch 1930
Validation auc = 0.713760
Epoch 1931
Validation auc = 0.713706
Epoch 1932
Validation auc = 0.713706
Epoch 1933
Loss = 1.4685e-05, PNorm = 129.6495, GNorm = 0.0003, lr_0 = 9.0431e-04
Validation auc = 0.713542
Epoch 1934
Validation auc = 0.713406
Epoch 1935
Validation auc = 0.713406
Epoch 1936
Validation auc = 0.713569
Epoch 1937
Validation auc = 0.713024
Epoch 1938
Loss = 5.8482e-06, PNorm = 129.6502, GNorm = 0.0003, lr_0 = 9.0409e-04
Loss = 1.7881e-06, PNorm = 129.6502, GNorm = 0.0001, lr_0 = 9.0407e-04
Validation auc = 0.713487
Epoch 1939
Validation auc = 0.712860
Epoch 1940
Validation auc = 0.712942
Epoch 1941
Validation auc = 0.713051
Epoch 1942
Validation auc = 0.712833
Epoch 1943
Loss = 3.6907e-06, PNorm = 129.6505, GNorm = 0.0001, lr_0 = 9.0386e-04
Validation auc = 0.712670
Epoch 1944
Validation auc = 0.712561
Epoch 1945
Validation auc = 0.712452
Epoch 1946
Validation auc = 0.712452
Epoch 1947
Validation auc = 0.712397
Epoch 1948
Loss = 1.4678e-05, PNorm = 129.6514, GNorm = 0.0005, lr_0 = 9.0362e-04
Validation auc = 0.712397
Epoch 1949
Validation auc = 0.712315
Epoch 1950
Validation auc = 0.712315
Epoch 1951
Validation auc = 0.712479
Epoch 1952
Loss = 8.3023e-06, PNorm = 129.6521, GNorm = 0.0001, lr_0 = 9.0341e-04
Loss = 6.5366e-06, PNorm = 129.6521, GNorm = 0.0004, lr_0 = 9.0340e-04
Validation auc = 0.712561
Epoch 1953
Validation auc = 0.712424
Epoch 1954
Validation auc = 0.712370
Epoch 1955
Validation auc = 0.712370
Epoch 1956
Validation auc = 0.712424
Epoch 1957
Loss = 1.8982e-05, PNorm = 129.6529, GNorm = 0.0013, lr_0 = 9.0317e-04
Loss = 5.6425e-06, PNorm = 129.6530, GNorm = 0.0003, lr_0 = 9.0316e-04
Validation auc = 0.712615
Epoch 1958
Validation auc = 0.712615
Epoch 1959
Validation auc = 0.712670
Epoch 1960
Validation auc = 0.712561
Epoch 1961
Validation auc = 0.712779
Epoch 1962
Loss = 4.3272e-06, PNorm = 129.6537, GNorm = 0.0001, lr_0 = 9.0295e-04
Validation auc = 0.712779
Epoch 1963
Validation auc = 0.712833
Epoch 1964
Validation auc = 0.713079
Epoch 1965
Validation auc = 0.713079
Epoch 1966
Loss = 2.4226e-06, PNorm = 129.6544, GNorm = 0.0002, lr_0 = 9.0273e-04
Validation auc = 0.713024
Epoch 1967
Validation auc = 0.713160
Epoch 1968
Validation auc = 0.713378
Epoch 1969
Validation auc = 0.713324
Epoch 1970
Validation auc = 0.713378
Epoch 1971
Loss = 5.7612e-06, PNorm = 129.6554, GNorm = 0.0002, lr_0 = 9.0250e-04
Loss = 1.7881e-07, PNorm = 129.6555, GNorm = 0.0000, lr_0 = 9.0249e-04
Validation auc = 0.713378
Epoch 1972
Validation auc = 0.713487
Epoch 1973
Validation auc = 0.713596
Epoch 1974
Validation auc = 0.713706
Epoch 1975
Validation auc = 0.713706
Epoch 1976
Loss = 8.4877e-07, PNorm = 129.6563, GNorm = 0.0000, lr_0 = 9.0228e-04
Validation auc = 0.713706
Epoch 1977
Validation auc = 0.713760
Epoch 1978
Validation auc = 0.713815
Epoch 1979
Validation auc = 0.713869
Epoch 1980
Validation auc = 0.714033
Epoch 1981
Loss = 2.7585e-06, PNorm = 129.6573, GNorm = 0.0001, lr_0 = 9.0204e-04
Validation auc = 0.714033
Epoch 1982
Validation auc = 0.713978
Epoch 1983
Validation auc = 0.714033
Epoch 1984
Validation auc = 0.714087
Epoch 1985
Loss = 2.5212e-06, PNorm = 129.6584, GNorm = 0.0000, lr_0 = 9.0183e-04
Loss = 4.1723e-07, PNorm = 129.6584, GNorm = 0.0000, lr_0 = 9.0181e-04
Validation auc = 0.714196
Epoch 1986
Validation auc = 0.714360
Epoch 1987
Validation auc = 0.714360
Epoch 1988
Validation auc = 0.714305
Epoch 1989
Validation auc = 0.714305
Epoch 1990
Loss = 3.4034e-06, PNorm = 129.6593, GNorm = 0.0001, lr_0 = 9.0159e-04
Loss = 5.9605e-07, PNorm = 129.6593, GNorm = 0.0001, lr_0 = 9.0157e-04
Validation auc = 0.714414
Epoch 1991
Validation auc = 0.714414
Epoch 1992
Validation auc = 0.714360
Epoch 1993
Validation auc = 0.714469
Epoch 1994
Validation auc = 0.714414
Epoch 1995
Loss = 3.0326e-06, PNorm = 129.6599, GNorm = 0.0001, lr_0 = 9.0137e-04
Validation auc = 0.714360
Epoch 1996
Validation auc = 0.714414
Epoch 1997
Validation auc = 0.714469
Epoch 1998
Validation auc = 0.714578
Epoch 1999
Loss = 1.3056e-05, PNorm = 129.6606, GNorm = 0.0001, lr_0 = 9.0114e-04
Validation auc = 0.714578
Model 0 best validation auc = 0.730742 on epoch 1564
Loading pretrained parameter "encoder.encoder.0.cached_zero_vector".
Loading pretrained parameter "encoder.encoder.0.W_i.weight".
Loading pretrained parameter "encoder.encoder.0.W_h.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.bias".
Loading pretrained parameter "ffn.1.weight".
Loading pretrained parameter "ffn.1.bias".
Moving model to cuda
Model 0 test auc = 0.705443
Ensemble test auc = 0.705443
Fold 2
Splitting data with seed 2
Class sizes
sars_cov_two_active 0: 98.39%, 1: 1.61%
Total size = 3,294 | train size = 3,294 | val size = 1,096 | test size = 1,086
With class_balance, effective train size = 106
Building model 0
MoleculeModel(
  (sigmoid): Sigmoid()
  (encoder): MPN(
    (encoder): ModuleList(
      (0): MPNEncoder(
        (dropout_layer): Dropout(p=0.05, inplace=False)
        (act_func): ReLU()
        (W_i): Linear(in_features=147, out_features=2100, bias=False)
        (W_h): Linear(in_features=2100, out_features=2100, bias=False)
        (W_o): Linear(in_features=2233, out_features=2100, bias=True)
      )
    )
  )
  (ffn): Sequential(
    (0): Dropout(p=0.05, inplace=False)
    (1): Linear(in_features=2328, out_features=1, bias=True)
  )
)
Number of parameters = 9,412,429
Moving model to cuda
Epoch 0
Validation auc = 0.524941
Epoch 1
Validation auc = 0.616857
Epoch 2
Validation auc = 0.625416
Epoch 3
Validation auc = 0.601210
Epoch 4
Loss = 7.0839e-01, PNorm = 67.4096, GNorm = 1.5928, lr_0 = 2.0385e-04
Loss = 7.8038e-01, PNorm = 67.4114, GNorm = 2.8806, lr_0 = 2.1077e-04
Validation auc = 0.616420
Epoch 5
Validation auc = 0.642697
Epoch 6
Validation auc = 0.590961
Epoch 7
Validation auc = 0.609442
Epoch 8
Validation auc = 0.547293
Epoch 9
Loss = 6.9372e-01, PNorm = 67.4436, GNorm = 2.3465, lr_0 = 3.0077e-04
Validation auc = 0.644715
Epoch 10
Validation auc = 0.618492
Epoch 11
Validation auc = 0.613749
Epoch 12
Validation auc = 0.637464
Epoch 13
Validation auc = 0.597885
Epoch 14
Loss = 6.4430e-01, PNorm = 67.5003, GNorm = 1.3203, lr_0 = 4.0462e-04
Validation auc = 0.622799
Epoch 15
Validation auc = 0.592924
Epoch 16
Validation auc = 0.592651
Epoch 17
Validation auc = 0.619582
Epoch 18
Loss = 6.6429e-01, PNorm = 67.5748, GNorm = 1.1079, lr_0 = 4.9462e-04
Loss = 6.9066e-01, PNorm = 67.5827, GNorm = 2.3939, lr_0 = 5.0154e-04
Validation auc = 0.617620
Epoch 19
Validation auc = 0.616857
Epoch 20
Validation auc = 0.620782
Epoch 21
Validation auc = 0.608188
Epoch 22
Validation auc = 0.636046
Epoch 23
Loss = 5.9356e-01, PNorm = 67.7119, GNorm = 0.8250, lr_0 = 5.9846e-04
Loss = 4.1372e-01, PNorm = 67.7255, GNorm = 1.9870, lr_0 = 6.0538e-04
Validation auc = 0.567083
Epoch 24
Validation auc = 0.634902
Epoch 25
Validation auc = 0.644115
Epoch 26
Validation auc = 0.647495
Epoch 27
Validation auc = 0.618110
Epoch 28
Loss = 6.1353e-01, PNorm = 67.9063, GNorm = 0.8427, lr_0 = 6.9538e-04
Validation auc = 0.617565
Epoch 29
Validation auc = 0.637028
Epoch 30
Validation auc = 0.653819
Epoch 31
Validation auc = 0.660197
Epoch 32
Validation auc = 0.672682
Epoch 33
Loss = 6.9042e-01, PNorm = 68.1764, GNorm = 1.3604, lr_0 = 7.9923e-04
Validation auc = 0.664722
Epoch 34
Validation auc = 0.661124
Epoch 35
Validation auc = 0.655018
Epoch 36
Validation auc = 0.646623
Epoch 37
Loss = 6.3051e-01, PNorm = 68.4150, GNorm = 1.1728, lr_0 = 8.8923e-04
Loss = 3.6454e-01, PNorm = 68.4413, GNorm = 1.3617, lr_0 = 8.9615e-04
Validation auc = 0.643624
Epoch 38
Validation auc = 0.635937
Epoch 39
Validation auc = 0.629941
Epoch 40
Validation auc = 0.618274
Epoch 41
Validation auc = 0.587527
Epoch 42
Loss = 6.5455e-01, PNorm = 68.7696, GNorm = 0.9609, lr_0 = 9.8615e-04
Validation auc = 0.573189
Epoch 43
Validation auc = 0.535572
Epoch 44
Validation auc = 0.594123
Epoch 45
Validation auc = 0.608352
Epoch 46
Validation auc = 0.636155
Epoch 47
Loss = 5.0712e-01, PNorm = 69.2819, GNorm = 0.9577, lr_0 = 9.9977e-04
Validation auc = 0.620346
Epoch 48
Validation auc = 0.610042
Epoch 49
Validation auc = 0.611405
Epoch 50
Validation auc = 0.624216
Epoch 51
Loss = 5.7155e-01, PNorm = 69.7369, GNorm = 0.7120, lr_0 = 9.9954e-04
Loss = 6.4116e-01, PNorm = 69.7678, GNorm = 2.5225, lr_0 = 9.9952e-04
Validation auc = 0.626342
Epoch 52
Validation auc = 0.624162
Epoch 53
Validation auc = 0.594832
Epoch 54
Validation auc = 0.609061
Epoch 55
Validation auc = 0.610751
Epoch 56
Loss = 5.0605e-01, PNorm = 70.1608, GNorm = 0.7425, lr_0 = 9.9927e-04
Loss = 7.7381e-01, PNorm = 70.1835, GNorm = 2.2746, lr_0 = 9.9926e-04
Validation auc = 0.562940
Epoch 57
Validation auc = 0.564248
Epoch 58
Validation auc = 0.612005
Epoch 59
Validation auc = 0.605135
Epoch 60
Validation auc = 0.582729
Epoch 61
Loss = 5.3664e-01, PNorm = 70.5714, GNorm = 1.1667, lr_0 = 9.9903e-04
Validation auc = 0.616420
Epoch 62
Validation auc = 0.622254
Epoch 63
Validation auc = 0.594014
Epoch 64
Validation auc = 0.606226
Epoch 65
Validation auc = 0.593414
Epoch 66
Loss = 5.3604e-01, PNorm = 71.0671, GNorm = 1.3777, lr_0 = 9.9876e-04
Validation auc = 0.553399
Epoch 67
Validation auc = 0.564248
Epoch 68
Validation auc = 0.594668
Epoch 69
Validation auc = 0.607044
Epoch 70
Loss = 5.0209e-01, PNorm = 71.5181, GNorm = 0.9261, lr_0 = 9.9853e-04
Loss = 4.6521e-01, PNorm = 71.5547, GNorm = 2.4414, lr_0 = 9.9851e-04
Validation auc = 0.609442
Epoch 71
Validation auc = 0.604154
Epoch 72
Validation auc = 0.593251
Epoch 73
Validation auc = 0.610533
Epoch 74
Validation auc = 0.607861
Epoch 75
Loss = 4.5743e-01, PNorm = 72.0280, GNorm = 1.0340, lr_0 = 9.9828e-04
Validation auc = 0.616093
Epoch 76
Validation auc = 0.617947
Epoch 77
Validation auc = 0.602519
Epoch 78
Validation auc = 0.632121
Epoch 79
Validation auc = 0.622363
Epoch 80
Loss = 4.2342e-01, PNorm = 72.6208, GNorm = 1.2716, lr_0 = 9.9802e-04
Validation auc = 0.577386
Epoch 81
Validation auc = 0.589326
Epoch 82
Validation auc = 0.599357
Epoch 83
Validation auc = 0.626506
Epoch 84
Loss = 4.1614e-01, PNorm = 73.2354, GNorm = 1.3516, lr_0 = 9.9779e-04
Loss = 3.7628e-01, PNorm = 73.2960, GNorm = 2.7572, lr_0 = 9.9777e-04
Validation auc = 0.631140
Epoch 85
Validation auc = 0.627106
Epoch 86
Validation auc = 0.595595
Epoch 87
Validation auc = 0.567410
Epoch 88
Validation auc = 0.557869
Epoch 89
Loss = 4.1375e-01, PNorm = 73.9608, GNorm = 0.6453, lr_0 = 9.9752e-04
Loss = 4.2529e-01, PNorm = 74.0060, GNorm = 1.5554, lr_0 = 9.9750e-04
Validation auc = 0.568718
Epoch 90
Validation auc = 0.593360
Epoch 91
Validation auc = 0.599139
Epoch 92
Validation auc = 0.594069
Epoch 93
Validation auc = 0.598648
Epoch 94
Loss = 2.5164e-01, PNorm = 74.5685, GNorm = 1.2333, lr_0 = 9.9727e-04
Validation auc = 0.608352
Epoch 95
Validation auc = 0.599847
Epoch 96
Validation auc = 0.598321
Epoch 97
Validation auc = 0.639590
Epoch 98
Validation auc = 0.668320
Epoch 99
Loss = 2.8331e-01, PNorm = 75.3018, GNorm = 1.4575, lr_0 = 9.9701e-04
Validation auc = 0.683476
Epoch 100
Validation auc = 0.662978
Epoch 101
Validation auc = 0.628305
Epoch 102
Validation auc = 0.607207
Epoch 103
Loss = 3.0261e-01, PNorm = 76.0191, GNorm = 0.8008, lr_0 = 9.9678e-04
Loss = 2.0529e-01, PNorm = 76.0754, GNorm = 1.5943, lr_0 = 9.9676e-04
Validation auc = 0.570572
Epoch 104
Validation auc = 0.565556
Epoch 105
Validation auc = 0.577386
Epoch 106
Validation auc = 0.584365
Epoch 107
Validation auc = 0.588126
Epoch 108
Loss = 4.0132e-01, PNorm = 76.9402, GNorm = 2.4809, lr_0 = 9.9651e-04
Validation auc = 0.595486
Epoch 109
Validation auc = 0.607262
Epoch 110
Validation auc = 0.594723
Epoch 111
Validation auc = 0.617838
Epoch 112
Validation auc = 0.625089
Epoch 113
Loss = 2.1884e-01, PNorm = 77.9206, GNorm = 1.4437, lr_0 = 9.9627e-04
Validation auc = 0.637246
Epoch 114
Validation auc = 0.644224
Epoch 115
Validation auc = 0.673118
Epoch 116
Validation auc = 0.722183
Epoch 117
Loss = 5.2878e-01, PNorm = 78.6993, GNorm = 4.9251, lr_0 = 9.9604e-04
Loss = 2.5082e-01, PNorm = 78.7501, GNorm = 2.8571, lr_0 = 9.9602e-04
Validation auc = 0.659925
Epoch 118
Validation auc = 0.642098
Epoch 119
Validation auc = 0.624925
Epoch 120
Validation auc = 0.616802
Epoch 121
Validation auc = 0.613422
Epoch 122
Loss = 1.8421e-01, PNorm = 79.4184, GNorm = 0.9811, lr_0 = 9.9577e-04
Loss = 1.6154e-01, PNorm = 79.4516, GNorm = 2.2747, lr_0 = 9.9575e-04
Validation auc = 0.617511
Epoch 123
Validation auc = 0.627433
Epoch 124
Validation auc = 0.627433
Epoch 125
Validation auc = 0.610587
Epoch 126
Validation auc = 0.599084
Epoch 127
Loss = 1.4886e-01, PNorm = 79.8883, GNorm = 0.9268, lr_0 = 9.9552e-04
Validation auc = 0.597885
Epoch 128
Validation auc = 0.607262
Epoch 129
Validation auc = 0.645750
Epoch 130
Validation auc = 0.655182
Epoch 131
Validation auc = 0.632721
Epoch 132
Loss = 1.2440e-01, PNorm = 80.2883, GNorm = 0.9151, lr_0 = 9.9526e-04
Validation auc = 0.580385
Epoch 133
Validation auc = 0.573461
Epoch 134
Validation auc = 0.562231
Epoch 135
Validation auc = 0.569863
Epoch 136
Loss = 1.9677e-01, PNorm = 80.7396, GNorm = 1.5378, lr_0 = 9.9503e-04
Loss = 4.8439e-01, PNorm = 80.7808, GNorm = 2.3826, lr_0 = 9.9501e-04
Validation auc = 0.593087
Epoch 137
Validation auc = 0.611623
Epoch 138
Validation auc = 0.612659
Epoch 139
Validation auc = 0.602246
Epoch 140
Validation auc = 0.573080
Epoch 141
Loss = 1.2346e-01, PNorm = 81.2767, GNorm = 0.7144, lr_0 = 9.9477e-04
Validation auc = 0.522325
Epoch 142
Validation auc = 0.575478
Epoch 143
Validation auc = 0.612604
Epoch 144
Validation auc = 0.627705
Epoch 145
Validation auc = 0.628360
Epoch 146
Loss = 9.5307e-02, PNorm = 81.7193, GNorm = 0.8079, lr_0 = 9.9452e-04
Validation auc = 0.626397
Epoch 147
Validation auc = 0.612223
Epoch 148
Validation auc = 0.628087
Epoch 149
Validation auc = 0.631140
Epoch 150
Loss = 1.2185e-01, PNorm = 82.0903, GNorm = 1.7017, lr_0 = 9.9429e-04
Loss = 8.2551e-02, PNorm = 82.1052, GNorm = 5.0585, lr_0 = 9.9427e-04
Validation auc = 0.619364
Epoch 151
Validation auc = 0.598375
Epoch 152
Validation auc = 0.616311
Epoch 153
Validation auc = 0.618819
Epoch 154
Validation auc = 0.631576
Epoch 155
Loss = 1.5416e-01, PNorm = 82.5709, GNorm = 1.2746, lr_0 = 9.9403e-04
Loss = 1.3898e-01, PNorm = 82.6093, GNorm = 1.5744, lr_0 = 9.9401e-04
Validation auc = 0.646786
Epoch 156
Validation auc = 0.643134
Epoch 157
Validation auc = 0.646296
Epoch 158
Validation auc = 0.643842
Epoch 159
Validation auc = 0.645478
Epoch 160
Loss = 1.2271e-01, PNorm = 83.0312, GNorm = 1.2070, lr_0 = 9.9378e-04
Validation auc = 0.652292
Epoch 161
Validation auc = 0.634738
Epoch 162
Validation auc = 0.654091
Epoch 163
Validation auc = 0.624598
Epoch 164
Validation auc = 0.633811
Epoch 165
Loss = 2.7498e-01, PNorm = 83.5626, GNorm = 1.4614, lr_0 = 9.9351e-04
Validation auc = 0.632503
Epoch 166
Validation auc = 0.654746
Epoch 167
Validation auc = 0.670774
Epoch 168
Validation auc = 0.662324
Epoch 169
Loss = 2.0614e-01, PNorm = 84.2737, GNorm = 1.4366, lr_0 = 9.9329e-04
Loss = 2.3335e-02, PNorm = 84.3183, GNorm = 0.4752, lr_0 = 9.9327e-04
Validation auc = 0.634356
Epoch 170
Validation auc = 0.609769
Epoch 171
Validation auc = 0.642043
Epoch 172
Validation auc = 0.662814
Epoch 173
Validation auc = 0.665322
Epoch 174
Loss = 1.1405e-01, PNorm = 84.8739, GNorm = 0.3078, lr_0 = 9.9302e-04
Validation auc = 0.661669
Epoch 175
Validation auc = 0.651148
Epoch 176
Validation auc = 0.642643
Epoch 177
Validation auc = 0.625906
Epoch 178
Validation auc = 0.636101
Epoch 179
Loss = 2.0316e-01, PNorm = 85.3045, GNorm = 1.1252, lr_0 = 9.9277e-04
Validation auc = 0.635392
Epoch 180
Validation auc = 0.632557
Epoch 181
Validation auc = 0.612114
Epoch 182
Validation auc = 0.585400
Epoch 183
Loss = 1.0316e-01, PNorm = 85.7233, GNorm = 2.0287, lr_0 = 9.9253e-04
Validation auc = 0.589162
Epoch 184
Validation auc = 0.592706
Epoch 185
Validation auc = 0.634247
Epoch 186
Validation auc = 0.633266
Epoch 187
Validation auc = 0.638554
Epoch 188
Loss = 1.1389e-01, PNorm = 86.1628, GNorm = 0.7387, lr_0 = 9.9228e-04
Loss = 3.4874e-02, PNorm = 86.1897, GNorm = 0.7056, lr_0 = 9.9226e-04
Validation auc = 0.638064
Epoch 189
Validation auc = 0.628251
Epoch 190
Validation auc = 0.626261
Epoch 191
Validation auc = 0.626452
Epoch 192
Validation auc = 0.632830
Epoch 193
Loss = 4.3593e-02, PNorm = 86.4877, GNorm = 0.3704, lr_0 = 9.9204e-04
Validation auc = 0.632230
Epoch 194
Validation auc = 0.627378
Epoch 195
Validation auc = 0.609333
Epoch 196
Validation auc = 0.606335
Epoch 197
Validation auc = 0.607752
Epoch 198
Loss = 1.5667e-01, PNorm = 86.8700, GNorm = 0.7473, lr_0 = 9.9177e-04
Validation auc = 0.604263
Epoch 199
Validation auc = 0.596576
Epoch 200
Validation auc = 0.599575
Epoch 201
Validation auc = 0.595104
Epoch 202
Loss = 1.0072e-01, PNorm = 87.2096, GNorm = 0.2516, lr_0 = 9.9154e-04
Loss = 3.1484e-02, PNorm = 87.2364, GNorm = 1.0565, lr_0 = 9.9153e-04
Validation auc = 0.582020
Epoch 203
Validation auc = 0.586055
Epoch 204
Validation auc = 0.597012
Epoch 205
Validation auc = 0.611568
Epoch 206
Validation auc = 0.624925
Epoch 207
Loss = 3.3123e-02, PNorm = 87.4957, GNorm = 0.3531, lr_0 = 9.9128e-04
Loss = 9.9169e-02, PNorm = 87.5093, GNorm = 1.7938, lr_0 = 9.9126e-04
Validation auc = 0.633212
Epoch 208
Validation auc = 0.627596
Epoch 209
Validation auc = 0.621381
Epoch 210
Validation auc = 0.622254
Epoch 211
Validation auc = 0.631794
Epoch 212
Loss = 3.9525e-02, PNorm = 87.7227, GNorm = 0.3344, lr_0 = 9.9103e-04
Validation auc = 0.632830
Epoch 213
Validation auc = 0.629613
Epoch 214
Validation auc = 0.625361
Epoch 215
Validation auc = 0.624271
Epoch 216
Loss = 8.1421e-03, PNorm = 87.9164, GNorm = 0.1354, lr_0 = 9.9079e-04
Validation auc = 0.621600
Epoch 217
Validation auc = 0.620673
Epoch 218
Validation auc = 0.620891
Epoch 219
Validation auc = 0.622908
Epoch 220
Validation auc = 0.625089
Epoch 221
Loss = 6.0156e-02, PNorm = 88.0520, GNorm = 1.0883, lr_0 = 9.9054e-04
Loss = 9.7074e-03, PNorm = 88.0620, GNorm = 0.2815, lr_0 = 9.9052e-04
Validation auc = 0.629995
Epoch 222
Validation auc = 0.633757
Epoch 223
Validation auc = 0.632067
Epoch 224
Validation auc = 0.630704
Epoch 225
Validation auc = 0.629777
Epoch 226
Loss = 9.3987e-02, PNorm = 88.1696, GNorm = 0.8620, lr_0 = 9.9030e-04
Validation auc = 0.626288
Epoch 227
Validation auc = 0.625034
Epoch 228
Validation auc = 0.623617
Epoch 229
Validation auc = 0.624434
Epoch 230
Validation auc = 0.624380
Epoch 231
Loss = 7.2373e-03, PNorm = 88.2484, GNorm = 0.1197, lr_0 = 9.9003e-04
Validation auc = 0.630976
Epoch 232
Validation auc = 0.638772
Epoch 233
Validation auc = 0.637518
Epoch 234
Validation auc = 0.635174
Epoch 235
Loss = 2.6817e-02, PNorm = 88.3339, GNorm = 0.7995, lr_0 = 9.8980e-04
Loss = 2.6748e-03, PNorm = 88.3402, GNorm = 0.0997, lr_0 = 9.8979e-04
Validation auc = 0.636973
Epoch 236
Validation auc = 0.638609
Epoch 237
Validation auc = 0.637300
Epoch 238
Validation auc = 0.643406
Epoch 239
Validation auc = 0.641335
Epoch 240
Loss = 1.9919e-02, PNorm = 88.5659, GNorm = 0.4137, lr_0 = 9.8954e-04
Loss = 3.0739e-02, PNorm = 88.5932, GNorm = 0.7821, lr_0 = 9.8952e-04
Validation auc = 0.639699
Epoch 241
Validation auc = 0.638118
Epoch 242
Validation auc = 0.643624
Epoch 243
Validation auc = 0.640680
Epoch 244
Validation auc = 0.631413
Epoch 245
Loss = 1.2534e-02, PNorm = 89.0167, GNorm = 0.1877, lr_0 = 9.8930e-04
Validation auc = 0.613422
Epoch 246
Validation auc = 0.606662
Epoch 247
Validation auc = 0.602573
Epoch 248
Validation auc = 0.599030
Epoch 249
Loss = 2.9600e-02, PNorm = 89.3068, GNorm = 0.2406, lr_0 = 9.8905e-04
Validation auc = 0.613204
Epoch 250
Validation auc = 0.606662
Epoch 251
Validation auc = 0.620128
Epoch 252
Validation auc = 0.627215
Epoch 253
Validation auc = 0.642643
Epoch 254
Loss = 5.4101e-02, PNorm = 89.5877, GNorm = 0.4809, lr_0 = 9.8880e-04
Loss = 3.0590e-02, PNorm = 89.6071, GNorm = 0.6561, lr_0 = 9.8879e-04
Validation auc = 0.658071
Epoch 255
Validation auc = 0.662651
Epoch 256
Validation auc = 0.665267
Epoch 257
Validation auc = 0.666194
Epoch 258
Validation auc = 0.669683
Epoch 259
Loss = 1.2131e-02, PNorm = 89.7951, GNorm = 0.1460, lr_0 = 9.8856e-04
Validation auc = 0.666412
Epoch 260
Validation auc = 0.661451
Epoch 261
Validation auc = 0.659598
Epoch 262
Validation auc = 0.656054
Epoch 263
Validation auc = 0.655182
Epoch 264
Loss = 7.5052e-02, PNorm = 89.9330, GNorm = 1.3267, lr_0 = 9.8830e-04
Validation auc = 0.650166
Epoch 265
Validation auc = 0.645260
Epoch 266
Validation auc = 0.637955
Epoch 267
Validation auc = 0.629341
Epoch 268
Loss = 1.2830e-02, PNorm = 90.0083, GNorm = 0.1109, lr_0 = 9.8807e-04
Loss = 7.1081e-03, PNorm = 90.0136, GNorm = 0.1945, lr_0 = 9.8805e-04
Validation auc = 0.626124
Epoch 269
Validation auc = 0.625361
Epoch 270
Validation auc = 0.636210
Epoch 271
Validation auc = 0.637573
Epoch 272
Validation auc = 0.638118
Epoch 273
Loss = 6.3814e-02, PNorm = 90.0735, GNorm = 0.7707, lr_0 = 9.8781e-04
Loss = 3.3824e-03, PNorm = 90.0760, GNorm = 0.0983, lr_0 = 9.8779e-04
Validation auc = 0.637355
Epoch 274
Validation auc = 0.638391
Epoch 275
Validation auc = 0.638282
Epoch 276
Validation auc = 0.636101
Epoch 277
Validation auc = 0.633648
Epoch 278
Loss = 5.1530e-02, PNorm = 90.1434, GNorm = 1.0763, lr_0 = 9.8756e-04
Validation auc = 0.648967
Epoch 279
Validation auc = 0.648912
Epoch 280
Validation auc = 0.645478
Epoch 281
Validation auc = 0.640462
Epoch 282
Validation auc = 0.637028
Epoch 283
Loss = 1.9016e-01, PNorm = 90.2536, GNorm = 0.8044, lr_0 = 9.8730e-04
Validation auc = 0.633430
Epoch 284
Validation auc = 0.635556
Epoch 285
Validation auc = 0.638282
Epoch 286
Validation auc = 0.637682
Epoch 287
Loss = 1.6099e-02, PNorm = 90.3444, GNorm = 0.3366, lr_0 = 9.8707e-04
Loss = 4.1720e-05, PNorm = 90.3501, GNorm = 0.0024, lr_0 = 9.8705e-04
Validation auc = 0.637845
Epoch 288
Validation auc = 0.644006
Epoch 289
Validation auc = 0.661179
Epoch 290
Validation auc = 0.662978
Epoch 291
Validation auc = 0.654473
Epoch 292
Loss = 1.8267e-02, PNorm = 90.5648, GNorm = 0.9594, lr_0 = 9.8683e-04
Validation auc = 0.651638
Epoch 293
Validation auc = 0.640135
Epoch 294
Validation auc = 0.622908
Epoch 295
Validation auc = 0.609715
Epoch 296
Validation auc = 0.608461
Epoch 297
Loss = 1.9228e-02, PNorm = 91.1377, GNorm = 0.2729, lr_0 = 9.8656e-04
Validation auc = 0.604590
Epoch 298
Validation auc = 0.592379
Epoch 299
Validation auc = 0.582020
Epoch 300
Validation auc = 0.583274
Epoch 301
Loss = 5.8197e-02, PNorm = 91.4219, GNorm = 0.9097, lr_0 = 9.8634e-04
Loss = 9.1288e-02, PNorm = 91.4411, GNorm = 1.5639, lr_0 = 9.8632e-04
Validation auc = 0.607698
Epoch 302
Validation auc = 0.629123
Epoch 303
Validation auc = 0.636973
Epoch 304
Validation auc = 0.642916
Epoch 305
Validation auc = 0.644278
Epoch 306
Loss = 3.8443e-02, PNorm = 91.6797, GNorm = 0.8077, lr_0 = 9.8607e-04
Loss = 8.8646e-03, PNorm = 91.6947, GNorm = 0.3444, lr_0 = 9.8606e-04
Validation auc = 0.639808
Epoch 307
Validation auc = 0.629723
Epoch 308
Validation auc = 0.621709
Epoch 309
Validation auc = 0.618819
Epoch 310
Validation auc = 0.617674
Epoch 311
Loss = 1.2934e-02, PNorm = 91.8562, GNorm = 0.2292, lr_0 = 9.8583e-04
Validation auc = 0.616857
Epoch 312
Validation auc = 0.613913
Epoch 313
Validation auc = 0.613695
Epoch 314
Validation auc = 0.615112
Epoch 315
Validation auc = 0.619364
Epoch 316
Loss = 2.2229e-03, PNorm = 91.9850, GNorm = 0.0436, lr_0 = 9.8557e-04
Validation auc = 0.619691
Epoch 317
Validation auc = 0.616802
Epoch 318
Validation auc = 0.615766
Epoch 319
Validation auc = 0.613749
Epoch 320
Loss = 1.2970e-02, PNorm = 92.0634, GNorm = 0.4793, lr_0 = 9.8534e-04
Loss = 4.1535e-03, PNorm = 92.0705, GNorm = 0.1300, lr_0 = 9.8532e-04
Validation auc = 0.597667
Epoch 321
Validation auc = 0.591779
Epoch 322
Validation auc = 0.598866
Epoch 323
Validation auc = 0.602519
Epoch 324
Validation auc = 0.602955
Epoch 325
Loss = 2.7647e-02, PNorm = 92.2327, GNorm = 0.3685, lr_0 = 9.8509e-04
Validation auc = 0.602301
Epoch 326
Validation auc = 0.612223
Epoch 327
Validation auc = 0.623617
Epoch 328
Validation auc = 0.628196
Epoch 329
Validation auc = 0.646459
Epoch 330
Loss = 1.5044e-01, PNorm = 92.4619, GNorm = 3.9129, lr_0 = 9.8483e-04
Validation auc = 0.616802
Epoch 331
Validation auc = 0.612223
Epoch 332
Validation auc = 0.620673
Epoch 333
Validation auc = 0.615221
Epoch 334
Loss = 4.8852e-02, PNorm = 92.8576, GNorm = 1.0775, lr_0 = 9.8461e-04
Loss = 2.2204e-01, PNorm = 92.8907, GNorm = 2.9171, lr_0 = 9.8459e-04
Validation auc = 0.608952
Epoch 335
Validation auc = 0.617238
Epoch 336
Validation auc = 0.598703
Epoch 337
Validation auc = 0.588671
Epoch 338
Validation auc = 0.588562
Epoch 339
Loss = 6.0430e-02, PNorm = 93.3989, GNorm = 0.2060, lr_0 = 9.8434e-04
Loss = 6.5245e-02, PNorm = 93.4354, GNorm = 2.3700, lr_0 = 9.8433e-04
Validation auc = 0.584746
Epoch 340
Validation auc = 0.596140
Epoch 341
Validation auc = 0.588508
Epoch 342
Validation auc = 0.615984
Epoch 343
Validation auc = 0.634574
Epoch 344
Loss = 4.1804e-01, PNorm = 93.8999, GNorm = 6.3558, lr_0 = 9.8410e-04
Validation auc = 0.650112
Epoch 345
Validation auc = 0.678024
Epoch 346
Validation auc = 0.696833
Epoch 347
Validation auc = 0.697705
Epoch 348
Validation auc = 0.694815
Epoch 349
Loss = 2.0773e-01, PNorm = 94.4041, GNorm = 1.7674, lr_0 = 9.8384e-04
Validation auc = 0.675735
Epoch 350
Validation auc = 0.655727
Epoch 351
Validation auc = 0.651420
Epoch 352
Validation auc = 0.644442
Epoch 353
Loss = 7.8633e-02, PNorm = 94.7456, GNorm = 1.0768, lr_0 = 9.8361e-04
Loss = 3.2627e-02, PNorm = 94.7663, GNorm = 0.8069, lr_0 = 9.8359e-04
Validation auc = 0.639099
Epoch 354
Validation auc = 0.641880
Epoch 355
Validation auc = 0.646568
Epoch 356
Validation auc = 0.650820
Epoch 357
Validation auc = 0.656490
Epoch 358
Loss = 1.1275e-01, PNorm = 95.0228, GNorm = 0.5268, lr_0 = 9.8335e-04
Validation auc = 0.660743
Epoch 359
Validation auc = 0.645314
Epoch 360
Validation auc = 0.635338
Epoch 361
Validation auc = 0.630159
Epoch 362
Validation auc = 0.629613
Epoch 363
Loss = 1.1554e-01, PNorm = 95.2753, GNorm = 1.1115, lr_0 = 9.8311e-04
Validation auc = 0.625361
Epoch 364
Validation auc = 0.618274
Epoch 365
Validation auc = 0.609115
Epoch 366
Validation auc = 0.601592
Epoch 367
Loss = 1.3187e-01, PNorm = 95.4321, GNorm = 2.0969, lr_0 = 9.8288e-04
Loss = 5.4072e-03, PNorm = 95.4393, GNorm = 0.0994, lr_0 = 9.8286e-04
Validation auc = 0.602137
Epoch 368
Validation auc = 0.610914
Epoch 369
Validation auc = 0.617075
Epoch 370
Validation auc = 0.617129
Epoch 371
Validation auc = 0.618383
Epoch 372
Loss = 3.3094e-02, PNorm = 95.5692, GNorm = 0.1039, lr_0 = 9.8262e-04
Loss = 1.2196e-02, PNorm = 95.5785, GNorm = 0.4217, lr_0 = 9.8260e-04
Validation auc = 0.619473
Epoch 373
Validation auc = 0.622744
Epoch 374
Validation auc = 0.621054
Epoch 375
Validation auc = 0.600556
Epoch 376
Validation auc = 0.585564
Epoch 377
Loss = 2.7776e-02, PNorm = 95.8363, GNorm = 0.5313, lr_0 = 9.8237e-04
Validation auc = 0.582620
Epoch 378
Validation auc = 0.582566
Epoch 379
Validation auc = 0.578041
Epoch 380
Validation auc = 0.575587
Epoch 381
Validation auc = 0.571335
Epoch 382
Loss = 2.9338e-02, PNorm = 96.1713, GNorm = 0.4174, lr_0 = 9.8211e-04
Validation auc = 0.576296
Epoch 383
Validation auc = 0.596631
Epoch 384
Validation auc = 0.602846
Epoch 385
Validation auc = 0.600829
Epoch 386
Loss = 4.9283e-02, PNorm = 96.4284, GNorm = 1.0286, lr_0 = 9.8189e-04
Loss = 2.6396e-02, PNorm = 96.4430, GNorm = 0.7060, lr_0 = 9.8187e-04
Validation auc = 0.598539
Epoch 387
Validation auc = 0.597067
Epoch 388
Validation auc = 0.600120
Epoch 389
Validation auc = 0.605899
Epoch 390
Validation auc = 0.610860
Epoch 391
Loss = 1.2027e-02, PNorm = 96.5990, GNorm = 0.2017, lr_0 = 9.8163e-04
Validation auc = 0.612986
Epoch 392
Validation auc = 0.614185
Epoch 393
Validation auc = 0.615276
Epoch 394
Validation auc = 0.617075
Epoch 395
Validation auc = 0.621436
Epoch 396
Loss = 4.1815e-03, PNorm = 96.6686, GNorm = 0.0851, lr_0 = 9.8138e-04
Validation auc = 0.626670
Epoch 397
Validation auc = 0.628196
Epoch 398
Validation auc = 0.627051
Epoch 399
Validation auc = 0.627433
Epoch 400
Loss = 6.3228e-02, PNorm = 96.7164, GNorm = 0.7754, lr_0 = 9.8116e-04
Loss = 9.9750e-04, PNorm = 96.7210, GNorm = 0.0384, lr_0 = 9.8114e-04
Validation auc = 0.628850
Epoch 401
Validation auc = 0.629941
Epoch 402
Validation auc = 0.633266
Epoch 403
Validation auc = 0.635556
Epoch 404
Validation auc = 0.634902
Epoch 405
Loss = 3.5990e-02, PNorm = 96.7693, GNorm = 0.6692, lr_0 = 9.8089e-04
Loss = 1.2488e-03, PNorm = 96.7725, GNorm = 0.0287, lr_0 = 9.8088e-04
Validation auc = 0.635828
Epoch 406
Validation auc = 0.637137
Epoch 407
Validation auc = 0.638609
Epoch 408
Validation auc = 0.640735
Epoch 409
Validation auc = 0.642479
Epoch 410
Loss = 6.3020e-03, PNorm = 96.8141, GNorm = 0.1102, lr_0 = 9.8065e-04
Validation auc = 0.641989
Epoch 411
Validation auc = 0.642479
Epoch 412
Validation auc = 0.642370
Epoch 413
Validation auc = 0.641934
Epoch 414
Validation auc = 0.642479
Epoch 415
Loss = 9.3104e-03, PNorm = 96.8621, GNorm = 0.2031, lr_0 = 9.8039e-04
Validation auc = 0.641553
Epoch 416
Validation auc = 0.639863
Epoch 417
Validation auc = 0.638391
Epoch 418
Validation auc = 0.635937
Epoch 419
Loss = 4.0636e-03, PNorm = 96.8987, GNorm = 0.1102, lr_0 = 9.8016e-04
Loss = 2.9153e-03, PNorm = 96.9024, GNorm = 0.0944, lr_0 = 9.8015e-04
Validation auc = 0.633648
Epoch 420
Validation auc = 0.631631
Epoch 421
Validation auc = 0.627160
Epoch 422
Validation auc = 0.624816
Epoch 423
Validation auc = 0.624980
Epoch 424
Loss = 1.5588e-03, PNorm = 96.9439, GNorm = 0.0230, lr_0 = 9.7990e-04
Validation auc = 0.627378
Epoch 425
Validation auc = 0.628469
Epoch 426
Validation auc = 0.629123
Epoch 427
Validation auc = 0.630486
Epoch 428
Validation auc = 0.635992
Epoch 429
Loss = 4.4070e-02, PNorm = 96.9683, GNorm = 0.7846, lr_0 = 9.7966e-04
Validation auc = 0.642316
Epoch 430
Validation auc = 0.644551
Epoch 431
Validation auc = 0.644060
Epoch 432
Validation auc = 0.642970
Epoch 433
Loss = 1.7175e-02, PNorm = 96.9858, GNorm = 0.0576, lr_0 = 9.7942e-04
Validation auc = 0.642752
Epoch 434
Validation auc = 0.641062
Epoch 435
Validation auc = 0.639590
Epoch 436
Validation auc = 0.641062
Epoch 437
Validation auc = 0.636374
Epoch 438
Loss = 4.3150e-03, PNorm = 97.0376, GNorm = 0.0586, lr_0 = 9.7917e-04
Loss = 8.5105e-03, PNorm = 97.0430, GNorm = 0.2065, lr_0 = 9.7916e-04
Validation auc = 0.629123
Epoch 439
Validation auc = 0.626288
Epoch 440
Validation auc = 0.626506
Epoch 441
Validation auc = 0.628142
Epoch 442
Validation auc = 0.628469
Epoch 443
Loss = 1.8902e-03, PNorm = 97.0955, GNorm = 0.0368, lr_0 = 9.7893e-04
Validation auc = 0.631031
Epoch 444
Validation auc = 0.632666
Epoch 445
Validation auc = 0.632775
Epoch 446
Validation auc = 0.637464
Epoch 447
Validation auc = 0.627814
Epoch 448
Loss = 4.3279e-03, PNorm = 97.1615, GNorm = 0.0980, lr_0 = 9.7867e-04
Validation auc = 0.620891
Epoch 449
Validation auc = 0.613204
Epoch 450
Validation auc = 0.608788
Epoch 451
Validation auc = 0.611296
Epoch 452
Loss = 1.8673e-02, PNorm = 97.2311, GNorm = 0.5388, lr_0 = 9.7845e-04
Loss = 1.8745e-03, PNorm = 97.2358, GNorm = 0.0656, lr_0 = 9.7843e-04
Validation auc = 0.620509
Epoch 453
Validation auc = 0.627160
Epoch 454
Validation auc = 0.630649
Epoch 455
Validation auc = 0.630867
Epoch 456
Validation auc = 0.631685
Epoch 457
Loss = 4.1196e-03, PNorm = 97.2931, GNorm = 0.0771, lr_0 = 9.7819e-04
Loss = 1.0655e-03, PNorm = 97.2961, GNorm = 0.0540, lr_0 = 9.7817e-04
Validation auc = 0.629886
Epoch 458
Validation auc = 0.628741
Epoch 459
Validation auc = 0.628087
Epoch 460
Validation auc = 0.625961
Epoch 461
Validation auc = 0.624543
Epoch 462
Loss = 5.4974e-04, PNorm = 97.3165, GNorm = 0.0105, lr_0 = 9.7794e-04
Validation auc = 0.617620
Epoch 463
Validation auc = 0.617674
Epoch 464
Validation auc = 0.616748
Epoch 465
Validation auc = 0.614676
Epoch 466
Loss = 3.6349e-03, PNorm = 97.4006, GNorm = 0.1785, lr_0 = 9.7770e-04
Validation auc = 0.613095
Epoch 467
Validation auc = 0.612822
Epoch 468
Validation auc = 0.615548
Epoch 469
Validation auc = 0.620237
Epoch 470
Validation auc = 0.615603
Epoch 471
Loss = 4.7923e-02, PNorm = 97.5166, GNorm = 0.7648, lr_0 = 9.7746e-04
Loss = 1.8821e-03, PNorm = 97.5220, GNorm = 0.0538, lr_0 = 9.7744e-04
Validation auc = 0.615821
Epoch 472
Validation auc = 0.612713
Epoch 473
Validation auc = 0.610206
Epoch 474
Validation auc = 0.605081
Epoch 475
Validation auc = 0.604972
Epoch 476
Loss = 6.3182e-03, PNorm = 97.6031, GNorm = 0.1114, lr_0 = 9.7721e-04
Validation auc = 0.600502
Epoch 477
Validation auc = 0.588835
Epoch 478
Validation auc = 0.585782
Epoch 479
Validation auc = 0.586872
Epoch 480
Validation auc = 0.601265
Epoch 481
Loss = 3.2186e-01, PNorm = 97.7556, GNorm = 5.3973, lr_0 = 9.7695e-04
Validation auc = 0.601374
Epoch 482
Validation auc = 0.603391
Epoch 483
Validation auc = 0.600338
Epoch 484
Validation auc = 0.595322
Epoch 485
Loss = 9.4958e-03, PNorm = 97.9956, GNorm = 0.1016, lr_0 = 9.7673e-04
Loss = 6.2986e-04, PNorm = 98.0108, GNorm = 0.0242, lr_0 = 9.7671e-04
Validation auc = 0.591070
Epoch 486
Validation auc = 0.598648
Epoch 487
Validation auc = 0.602900
Epoch 488
Validation auc = 0.604699
Epoch 489
Validation auc = 0.604100
Epoch 490
Loss = 4.6429e-02, PNorm = 98.2058, GNorm = 0.4910, lr_0 = 9.7647e-04
Loss = 2.4063e-04, PNorm = 98.2148, GNorm = 0.0087, lr_0 = 9.7645e-04
Validation auc = 0.608352
Epoch 491
Validation auc = 0.610860
Epoch 492
Validation auc = 0.611241
Epoch 493
Validation auc = 0.617238
Epoch 494
Validation auc = 0.622635
Epoch 495
Loss = 8.2626e-02, PNorm = 98.3070, GNorm = 0.7684, lr_0 = 9.7623e-04
Validation auc = 0.622799
Epoch 496
Validation auc = 0.621545
Epoch 497
Validation auc = 0.621927
Epoch 498
Validation auc = 0.629723
Epoch 499
Loss = 5.5268e-02, PNorm = 98.3929, GNorm = 0.1907, lr_0 = 9.7599e-04
Validation auc = 0.637464
Epoch 500
Validation auc = 0.645478
Epoch 501
Validation auc = 0.648313
Epoch 502
Validation auc = 0.647549
Epoch 503
Validation auc = 0.647713
Epoch 504
Loss = 2.9245e-03, PNorm = 98.4592, GNorm = 0.0900, lr_0 = 9.7574e-04
Loss = 2.5805e-04, PNorm = 98.4631, GNorm = 0.0074, lr_0 = 9.7573e-04
Validation auc = 0.646677
Epoch 505
Validation auc = 0.646514
Epoch 506
Validation auc = 0.647604
Epoch 507
Validation auc = 0.649239
Epoch 508
Validation auc = 0.650493
Epoch 509
Loss = 2.2652e-02, PNorm = 98.5055, GNorm = 0.3716, lr_0 = 9.7550e-04
Validation auc = 0.649458
Epoch 510
Validation auc = 0.648912
Epoch 511
Validation auc = 0.655836
Epoch 512
Validation auc = 0.662051
Epoch 513
Validation auc = 0.674481
Epoch 514
Loss = 1.0264e-01, PNorm = 98.7452, GNorm = 1.1175, lr_0 = 9.7524e-04
Validation auc = 0.691872
Epoch 515
Validation auc = 0.699613
Epoch 516
Validation auc = 0.701139
Epoch 517
Validation auc = 0.695579
Epoch 518
Loss = 2.8972e-02, PNorm = 99.0080, GNorm = 0.2758, lr_0 = 9.7502e-04
Loss = 1.1058e-03, PNorm = 99.0227, GNorm = 0.0389, lr_0 = 9.7500e-04
Validation auc = 0.688273
Epoch 519
Validation auc = 0.678515
Epoch 520
Validation auc = 0.658725
Epoch 521
Validation auc = 0.657308
Epoch 522
Validation auc = 0.665867
Epoch 523
Loss = 9.9313e-03, PNorm = 99.2122, GNorm = 0.1175, lr_0 = 9.7476e-04
Loss = 3.1853e-03, PNorm = 99.2223, GNorm = 0.0739, lr_0 = 9.7474e-04
Validation auc = 0.675189
Epoch 524
Validation auc = 0.682059
Epoch 525
Validation auc = 0.681241
Epoch 526
Validation auc = 0.680968
Epoch 527
Validation auc = 0.674644
Epoch 528
Loss = 1.2785e-01, PNorm = 99.3376, GNorm = 0.9270, lr_0 = 9.7452e-04
Validation auc = 0.668866
Epoch 529
Validation auc = 0.663141
Epoch 530
Validation auc = 0.660361
Epoch 531
Validation auc = 0.656490
Epoch 532
Validation auc = 0.655073
Epoch 533
Loss = 3.9484e-03, PNorm = 99.4106, GNorm = 0.0756, lr_0 = 9.7426e-04
Validation auc = 0.654146
Epoch 534
Validation auc = 0.653873
Epoch 535
Validation auc = 0.654691
Epoch 536
Validation auc = 0.655509
Epoch 537
Loss = 9.2926e-04, PNorm = 99.4430, GNorm = 0.0176, lr_0 = 9.7403e-04
Loss = 2.9697e-04, PNorm = 99.4446, GNorm = 0.0098, lr_0 = 9.7401e-04
Validation auc = 0.656272
Epoch 538
Validation auc = 0.656926
Epoch 539
Validation auc = 0.657799
Epoch 540
Validation auc = 0.655291
Epoch 541
Validation auc = 0.650112
Epoch 542
Loss = 8.1649e-04, PNorm = 99.4709, GNorm = 0.0175, lr_0 = 9.7379e-04
Validation auc = 0.647168
Epoch 543
Validation auc = 0.648640
Epoch 544
Validation auc = 0.663959
Epoch 545
Validation auc = 0.668920
Epoch 546
Validation auc = 0.671918
Epoch 547
Loss = 5.3871e-02, PNorm = 99.5061, GNorm = 0.6036, lr_0 = 9.7353e-04
Validation auc = 0.673499
Epoch 548
Validation auc = 0.674372
Epoch 549
Validation auc = 0.670228
Epoch 550
Validation auc = 0.666739
Epoch 551
Loss = 1.7824e-02, PNorm = 99.5918, GNorm = 0.8337, lr_0 = 9.7331e-04
Loss = 1.3365e-04, PNorm = 99.5974, GNorm = 0.0057, lr_0 = 9.7329e-04
Validation auc = 0.663196
Epoch 552
Validation auc = 0.663850
Epoch 553
Validation auc = 0.664777
Epoch 554
Validation auc = 0.665485
Epoch 555
Validation auc = 0.664886
Epoch 556
Loss = 7.6154e-03, PNorm = 99.6577, GNorm = 0.3374, lr_0 = 9.7305e-04
Loss = 4.6926e-04, PNorm = 99.6605, GNorm = 0.0193, lr_0 = 9.7303e-04
Validation auc = 0.668211
Epoch 557
Validation auc = 0.671373
Epoch 558
Validation auc = 0.674971
Epoch 559
Validation auc = 0.679169
Epoch 560
Validation auc = 0.677861
Epoch 561
Loss = 5.6284e-03, PNorm = 99.7179, GNorm = 0.1287, lr_0 = 9.7281e-04
Validation auc = 0.663468
Epoch 562
Validation auc = 0.657690
Epoch 563
Validation auc = 0.657253
Epoch 564
Validation auc = 0.654691
Epoch 565
Validation auc = 0.657690
Epoch 566
Loss = 1.8827e-01, PNorm = 99.8321, GNorm = 1.8348, lr_0 = 9.7255e-04
Validation auc = 0.654746
Epoch 567
Validation auc = 0.660852
Epoch 568
Validation auc = 0.660252
Epoch 569
Validation auc = 0.657635
Epoch 570
Loss = 1.2525e-02, PNorm = 100.0345, GNorm = 0.3003, lr_0 = 9.7232e-04
Loss = 2.8331e-02, PNorm = 100.0504, GNorm = 1.1830, lr_0 = 9.7231e-04
Validation auc = 0.652238
Epoch 571
Validation auc = 0.645805
Epoch 572
Validation auc = 0.636428
Epoch 573
Validation auc = 0.629832
Epoch 574
Validation auc = 0.626942
Epoch 575
Loss = 1.0093e-01, PNorm = 100.2141, GNorm = 0.9763, lr_0 = 9.7208e-04
Validation auc = 0.624871
Epoch 576
Validation auc = 0.623508
Epoch 577
Validation auc = 0.624053
Epoch 578
Validation auc = 0.622581
Epoch 579
Validation auc = 0.625034
Epoch 580
Loss = 7.1591e-03, PNorm = 100.3820, GNorm = 0.1030, lr_0 = 9.7182e-04
Validation auc = 0.626779
Epoch 581
Validation auc = 0.627596
Epoch 582
Validation auc = 0.629723
Epoch 583
Validation auc = 0.632612
Epoch 584
Loss = 1.0681e-02, PNorm = 100.4519, GNorm = 0.0757, lr_0 = 9.7160e-04
Loss = 5.5230e-04, PNorm = 100.4556, GNorm = 0.0182, lr_0 = 9.7158e-04
Validation auc = 0.630976
Epoch 585
Validation auc = 0.630758
Epoch 586
Validation auc = 0.630704
Epoch 587
Validation auc = 0.631685
Epoch 588
Validation auc = 0.631849
Epoch 589
Loss = 5.0550e-03, PNorm = 100.5025, GNorm = 0.1811, lr_0 = 9.7134e-04
Loss = 1.6152e-03, PNorm = 100.5053, GNorm = 0.0499, lr_0 = 9.7132e-04
Validation auc = 0.630867
Epoch 590
Validation auc = 0.630649
Epoch 591
Validation auc = 0.630976
Epoch 592
Validation auc = 0.630213
Epoch 593
Validation auc = 0.628632
Epoch 594
Loss = 1.2974e-03, PNorm = 100.5330, GNorm = 0.0298, lr_0 = 9.7110e-04
Validation auc = 0.627542
Epoch 595
Validation auc = 0.627923
Epoch 596
Validation auc = 0.627378
Epoch 597
Validation auc = 0.624325
Epoch 598
Validation auc = 0.623181
Epoch 599
Loss = 3.3563e-02, PNorm = 100.5589, GNorm = 0.9093, lr_0 = 9.7084e-04
Validation auc = 0.632448
Epoch 600
Validation auc = 0.637845
Epoch 601
Validation auc = 0.640244
Epoch 602
Validation auc = 0.643079
Epoch 603
Loss = 7.4827e-03, PNorm = 100.5870, GNorm = 0.0970, lr_0 = 9.7062e-04
Loss = 2.1221e-03, PNorm = 100.5912, GNorm = 0.0786, lr_0 = 9.7060e-04
Validation auc = 0.643733
Epoch 604
Validation auc = 0.644224
Epoch 605
Validation auc = 0.644388
Epoch 606
Validation auc = 0.645151
Epoch 607
Validation auc = 0.645859
Epoch 608
Loss = 2.5478e-02, PNorm = 100.6371, GNorm = 0.0693, lr_0 = 9.7036e-04
Validation auc = 0.647113
Epoch 609
Validation auc = 0.648313
Epoch 610
Validation auc = 0.650166
Epoch 611
Validation auc = 0.650984
Epoch 612
Validation auc = 0.652674
Epoch 613
Loss = 1.0615e-03, PNorm = 100.6654, GNorm = 0.0253, lr_0 = 9.7012e-04
Validation auc = 0.655945
Epoch 614
Validation auc = 0.655618
Epoch 615
Validation auc = 0.649839
Epoch 616
Validation auc = 0.649621
Epoch 617
Loss = 5.2572e-03, PNorm = 100.6999, GNorm = 0.2232, lr_0 = 9.6990e-04
Loss = 1.5456e-03, PNorm = 100.7036, GNorm = 0.0496, lr_0 = 9.6988e-04
Validation auc = 0.649894
Epoch 618
Validation auc = 0.649021
Epoch 619
Validation auc = 0.647604
Epoch 620
Validation auc = 0.646786
Epoch 621
Validation auc = 0.647440
Epoch 622
Loss = 1.7271e-03, PNorm = 100.7408, GNorm = 0.0407, lr_0 = 9.6964e-04
Loss = 5.6853e-03, PNorm = 100.7440, GNorm = 0.1802, lr_0 = 9.6962e-04
Validation auc = 0.649076
Epoch 623
Validation auc = 0.650984
Epoch 624
Validation auc = 0.651475
Epoch 625
Validation auc = 0.650657
Epoch 626
Validation auc = 0.650930
Epoch 627
Loss = 6.4406e-04, PNorm = 100.7725, GNorm = 0.0161, lr_0 = 9.6940e-04
Validation auc = 0.650657
Epoch 628
Validation auc = 0.650984
Epoch 629
Validation auc = 0.650057
Epoch 630
Validation auc = 0.649621
Epoch 631
Validation auc = 0.650166
Epoch 632
Loss = 8.9403e-04, PNorm = 100.8003, GNorm = 0.0173, lr_0 = 9.6914e-04
Validation auc = 0.650166
Epoch 633
Validation auc = 0.650330
Epoch 634
Validation auc = 0.650112
Epoch 635
Validation auc = 0.650439
Epoch 636
Loss = 7.2592e-04, PNorm = 100.8164, GNorm = 0.0102, lr_0 = 9.6892e-04
Loss = 4.4547e-04, PNorm = 100.8172, GNorm = 0.0116, lr_0 = 9.6890e-04
Validation auc = 0.650711
Epoch 637
Validation auc = 0.650439
Epoch 638
Validation auc = 0.650493
Epoch 639
Validation auc = 0.650330
Epoch 640
Validation auc = 0.650711
Epoch 641
Loss = 8.1082e-04, PNorm = 100.8261, GNorm = 0.0394, lr_0 = 9.6866e-04
Validation auc = 0.650439
Epoch 642
Validation auc = 0.650275
Epoch 643
Validation auc = 0.651911
Epoch 644
Validation auc = 0.653056
Epoch 645
Validation auc = 0.653110
Epoch 646
Loss = 6.2004e-04, PNorm = 100.8460, GNorm = 0.0113, lr_0 = 9.6842e-04
Validation auc = 0.653165
Epoch 647
Validation auc = 0.653056
Epoch 648
Validation auc = 0.652729
Epoch 649
Validation auc = 0.652947
Epoch 650
Loss = 1.1840e-02, PNorm = 100.8614, GNorm = 1.5465, lr_0 = 9.6820e-04
Loss = 4.9587e-04, PNorm = 100.8653, GNorm = 0.0228, lr_0 = 9.6818e-04
Validation auc = 0.650493
Epoch 651
Validation auc = 0.653764
Epoch 652
Validation auc = 0.659979
Epoch 653
Validation auc = 0.663196
Epoch 654
Validation auc = 0.664559
Epoch 655
Loss = 1.0224e-02, PNorm = 100.9255, GNorm = 0.1929, lr_0 = 9.6794e-04
Loss = 5.4713e-05, PNorm = 100.9302, GNorm = 0.0022, lr_0 = 9.6792e-04
Validation auc = 0.664831
Epoch 656
Validation auc = 0.667121
Epoch 657
Validation auc = 0.668866
Epoch 658
Validation auc = 0.669247
Epoch 659
Validation auc = 0.670174
Epoch 660
Loss = 2.8013e-03, PNorm = 101.0159, GNorm = 0.0419, lr_0 = 9.6770e-04
Validation auc = 0.669847
Epoch 661
Validation auc = 0.670665
Epoch 662
Validation auc = 0.669738
Epoch 663
Validation auc = 0.671373
Epoch 664
Validation auc = 0.669356
Epoch 665
Loss = 2.1090e-03, PNorm = 101.0968, GNorm = 0.0496, lr_0 = 9.6744e-04
Validation auc = 0.665649
Epoch 666
Validation auc = 0.661833
Epoch 667
Validation auc = 0.657962
Epoch 668
Validation auc = 0.655236
Epoch 669
Loss = 1.0503e-03, PNorm = 101.1447, GNorm = 0.0178, lr_0 = 9.6722e-04
Loss = 2.6244e-01, PNorm = 101.1389, GNorm = 15.9926, lr_0 = 9.6720e-04
Validation auc = 0.674971
Epoch 670
Validation auc = 0.697487
Epoch 671
Validation auc = 0.722892
Epoch 672
Validation auc = 0.723437
Epoch 673
Validation auc = 0.719402
Epoch 674
Loss = 4.9624e-02, PNorm = 101.5009, GNorm = 0.2475, lr_0 = 9.6696e-04
Validation auc = 0.703593
Epoch 675
Validation auc = 0.698414
Epoch 676
Validation auc = 0.690236
Epoch 677
Validation auc = 0.702884
Epoch 678
Validation auc = 0.714878
Epoch 679
Loss = 2.3467e-03, PNorm = 101.8867, GNorm = 0.0999, lr_0 = 9.6672e-04
Validation auc = 0.722183
Epoch 680
Validation auc = 0.717876
Epoch 681
Validation auc = 0.701466
Epoch 682
Validation auc = 0.694161
Epoch 683
Loss = 1.7803e-02, PNorm = 102.1230, GNorm = 0.0147, lr_0 = 9.6648e-04
Validation auc = 0.691763
Epoch 684
Validation auc = 0.689473
Epoch 685
Validation auc = 0.683258
Epoch 686
Validation auc = 0.680750
Epoch 687
Validation auc = 0.677806
Epoch 688
Loss = 5.9391e-02, PNorm = 102.2477, GNorm = 1.8042, lr_0 = 9.6624e-04
Loss = 2.4825e-03, PNorm = 102.2541, GNorm = 0.0760, lr_0 = 9.6622e-04
Validation auc = 0.679333
Epoch 689
Validation auc = 0.677261
Epoch 690
Validation auc = 0.673663
Epoch 691
Validation auc = 0.672137
Epoch 692
Validation auc = 0.669574
Epoch 693
Loss = 4.0455e-03, PNorm = 102.3416, GNorm = 0.1578, lr_0 = 9.6600e-04
Validation auc = 0.666031
Epoch 694
Validation auc = 0.664123
Epoch 695
Validation auc = 0.661179
Epoch 696
Validation auc = 0.657253
Epoch 697
Validation auc = 0.657908
Epoch 698
Loss = 1.2968e-03, PNorm = 102.4013, GNorm = 0.0302, lr_0 = 9.6574e-04
Validation auc = 0.660524
Epoch 699
Validation auc = 0.678460
Epoch 700
Validation auc = 0.672682
Epoch 701
Validation auc = 0.667448
Epoch 702
Loss = 1.2920e-03, PNorm = 102.4544, GNorm = 0.0252, lr_0 = 9.6552e-04
Loss = 5.4541e-02, PNorm = 102.4676, GNorm = 3.2678, lr_0 = 9.6550e-04
Validation auc = 0.661015
Epoch 703
Validation auc = 0.625252
Epoch 704
Validation auc = 0.633103
Epoch 705
Validation auc = 0.641607
Epoch 706
Validation auc = 0.639536
Epoch 707
Loss = 5.7004e-02, PNorm = 102.7023, GNorm = 1.1576, lr_0 = 9.6526e-04
Loss = 9.2000e-04, PNorm = 102.7234, GNorm = 0.0279, lr_0 = 9.6525e-04
Validation auc = 0.635992
Epoch 708
Validation auc = 0.635174
Epoch 709
Validation auc = 0.640353
Epoch 710
Validation auc = 0.640680
Epoch 711
Validation auc = 0.637028
Epoch 712
Loss = 7.4292e-02, PNorm = 102.9017, GNorm = 0.6488, lr_0 = 9.6502e-04
Validation auc = 0.638554
Epoch 713
Validation auc = 0.640462
Epoch 714
Validation auc = 0.641607
Epoch 715
Validation auc = 0.641989
Epoch 716
Loss = 6.4105e-02, PNorm = 103.0073, GNorm = 4.4013, lr_0 = 9.6479e-04
Validation auc = 0.634084
Epoch 717
Validation auc = 0.610914
Epoch 718
Validation auc = 0.603282
Epoch 719
Validation auc = 0.604481
Epoch 720
Validation auc = 0.607643
Epoch 721
Loss = 1.6198e-02, PNorm = 103.1492, GNorm = 0.1931, lr_0 = 9.6455e-04
Loss = 1.3934e-02, PNorm = 103.1583, GNorm = 0.4961, lr_0 = 9.6453e-04
Validation auc = 0.609987
Epoch 722
Validation auc = 0.612495
Epoch 723
Validation auc = 0.614730
Epoch 724
Validation auc = 0.615930
Epoch 725
Validation auc = 0.617238
Epoch 726
Loss = 3.1357e-02, PNorm = 103.2631, GNorm = 0.6820, lr_0 = 9.6431e-04
Validation auc = 0.621436
Epoch 727
Validation auc = 0.620891
Epoch 728
Validation auc = 0.621490
Epoch 729
Validation auc = 0.624216
Epoch 730
Validation auc = 0.624543
Epoch 731
Loss = 1.2483e-03, PNorm = 103.3486, GNorm = 0.0205, lr_0 = 9.6405e-04
Validation auc = 0.626179
Epoch 732
Validation auc = 0.626779
Epoch 733
Validation auc = 0.626452
Epoch 734
Validation auc = 0.627378
Epoch 735
Loss = 1.4750e-03, PNorm = 103.3888, GNorm = 0.0494, lr_0 = 9.6383e-04
Loss = 4.2875e-03, PNorm = 103.3917, GNorm = 0.1871, lr_0 = 9.6381e-04
Validation auc = 0.626888
Epoch 736
Validation auc = 0.626779
Epoch 737
Validation auc = 0.627814
Epoch 738
Validation auc = 0.627160
Epoch 739
Validation auc = 0.626506
Epoch 740
Loss = 1.7822e-03, PNorm = 103.4272, GNorm = 0.0250, lr_0 = 9.6357e-04
Loss = 1.5033e-03, PNorm = 103.4299, GNorm = 0.0530, lr_0 = 9.6355e-04
Validation auc = 0.625797
Epoch 741
Validation auc = 0.623562
Epoch 742
Validation auc = 0.622581
Epoch 743
Validation auc = 0.622090
Epoch 744
Validation auc = 0.622036
Epoch 745
Loss = 2.1159e-03, PNorm = 103.4660, GNorm = 0.0474, lr_0 = 9.6333e-04
Validation auc = 0.621163
Epoch 746
Validation auc = 0.620891
Epoch 747
Validation auc = 0.620836
Epoch 748
Validation auc = 0.620400
Epoch 749
Loss = 3.7922e-02, PNorm = 103.4972, GNorm = 0.0128, lr_0 = 9.6309e-04
Validation auc = 0.618274
Epoch 750
Validation auc = 0.617947
Epoch 751
Validation auc = 0.623944
Epoch 752
Validation auc = 0.625906
Epoch 753
Validation auc = 0.627814
Epoch 754
Loss = 1.1819e-03, PNorm = 103.5152, GNorm = 0.0237, lr_0 = 9.6285e-04
Loss = 1.6248e-03, PNorm = 103.5163, GNorm = 0.0385, lr_0 = 9.6284e-04
Validation auc = 0.628414
Epoch 755
Validation auc = 0.628360
Epoch 756
Validation auc = 0.627978
Epoch 757
Validation auc = 0.628196
Epoch 758
Validation auc = 0.629232
Epoch 759
Loss = 4.0324e-04, PNorm = 103.5319, GNorm = 0.0075, lr_0 = 9.6262e-04
Validation auc = 0.630922
Epoch 760
Validation auc = 0.633048
Epoch 761
Validation auc = 0.634793
Epoch 762
Validation auc = 0.634356
Epoch 763
Validation auc = 0.635610
Epoch 764
Loss = 3.6770e-02, PNorm = 103.5850, GNorm = 0.6743, lr_0 = 9.6236e-04
Validation auc = 0.636701
Epoch 765
Validation auc = 0.627978
Epoch 766
Validation auc = 0.606335
Epoch 767
Validation auc = 0.607589
Epoch 768
Loss = 1.6591e-01, PNorm = 103.9998, GNorm = 2.3717, lr_0 = 9.6214e-04
Loss = 1.2349e-02, PNorm = 104.0364, GNorm = 0.2697, lr_0 = 9.6212e-04
Validation auc = 0.619746
Epoch 769
Validation auc = 0.652347
Epoch 770
Validation auc = 0.670992
Epoch 771
Validation auc = 0.664232
Epoch 772
Validation auc = 0.645696
Epoch 773
Loss = 3.0867e-02, PNorm = 104.6055, GNorm = 0.8032, lr_0 = 9.6188e-04
Loss = 9.2428e-03, PNorm = 104.6387, GNorm = 0.4728, lr_0 = 9.6186e-04
Validation auc = 0.629504
Epoch 774
Validation auc = 0.611405
Epoch 775
Validation auc = 0.625743
Epoch 776
Validation auc = 0.643570
Epoch 777
Validation auc = 0.641389
Epoch 778
Loss = 2.9335e-02, PNorm = 105.0095, GNorm = 0.6308, lr_0 = 9.6164e-04
Validation auc = 0.633648
Epoch 779
Validation auc = 0.636374
Epoch 780
Validation auc = 0.640190
Epoch 781
Validation auc = 0.644606
Epoch 782
Validation auc = 0.644388
Epoch 783
Loss = 1.3969e-02, PNorm = 105.3486, GNorm = 0.2588, lr_0 = 9.6139e-04
Validation auc = 0.642643
Epoch 784
Validation auc = 0.635065
Epoch 785
Validation auc = 0.630595
Epoch 786
Validation auc = 0.632939
Epoch 787
Loss = 8.4118e-04, PNorm = 105.5732, GNorm = 0.0089, lr_0 = 9.6117e-04
Loss = 1.9170e+00, PNorm = 105.5840, GNorm = 6.2240, lr_0 = 9.6115e-04
Validation auc = 0.646350
Epoch 788
Validation auc = 0.651311
Epoch 789
Validation auc = 0.653601
Epoch 790
Validation auc = 0.618547
Epoch 791
Validation auc = 0.591670
Epoch 792
Loss = 1.8297e-02, PNorm = 105.8643, GNorm = 0.3186, lr_0 = 9.6093e-04
Validation auc = 0.611568
Epoch 793
Validation auc = 0.622254
Epoch 794
Validation auc = 0.623889
Epoch 795
Validation auc = 0.622199
Epoch 796
Validation auc = 0.626233
Epoch 797
Loss = 1.2171e-02, PNorm = 106.1227, GNorm = 0.5577, lr_0 = 9.6067e-04
Validation auc = 0.622962
Epoch 798
Validation auc = 0.611023
Epoch 799
Validation auc = 0.606062
Epoch 800
Validation auc = 0.604645
Epoch 801
Loss = 1.3881e-02, PNorm = 106.2823, GNorm = 0.0419, lr_0 = 9.6045e-04
Loss = 3.4150e-04, PNorm = 106.2922, GNorm = 0.0167, lr_0 = 9.6043e-04
Validation auc = 0.604917
Epoch 802
Validation auc = 0.604808
Epoch 803
Validation auc = 0.593087
Epoch 804
Validation auc = 0.594232
Epoch 805
Validation auc = 0.610315
Epoch 806
Loss = 3.2464e-03, PNorm = 106.4535, GNorm = 0.0377, lr_0 = 9.6019e-04
Loss = 1.6879e-03, PNorm = 106.4672, GNorm = 0.0417, lr_0 = 9.6018e-04
Validation auc = 0.633430
Epoch 807
Validation auc = 0.643243
Epoch 808
Validation auc = 0.646514
Epoch 809
Validation auc = 0.643570
Epoch 810
Validation auc = 0.640026
Epoch 811
Loss = 4.4937e-03, PNorm = 106.5935, GNorm = 0.0737, lr_0 = 9.5996e-04
Validation auc = 0.623889
Epoch 812
Validation auc = 0.613695
Epoch 813
Validation auc = 0.615821
Epoch 814
Validation auc = 0.618165
Epoch 815
Validation auc = 0.614894
Epoch 816
Loss = 1.2352e-02, PNorm = 106.7214, GNorm = 0.3519, lr_0 = 9.5970e-04
Validation auc = 0.613095
Epoch 817
Validation auc = 0.609769
Epoch 818
Validation auc = 0.607752
Epoch 819
Validation auc = 0.604536
Epoch 820
Loss = 4.1777e-03, PNorm = 106.8027, GNorm = 0.0932, lr_0 = 9.5948e-04
Loss = 1.8295e-04, PNorm = 106.8070, GNorm = 0.0051, lr_0 = 9.5946e-04
Validation auc = 0.600938
Epoch 821
Validation auc = 0.597776
Epoch 822
Validation auc = 0.592160
Epoch 823
Validation auc = 0.592379
Epoch 824
Validation auc = 0.592815
Epoch 825
Loss = 6.2542e-03, PNorm = 106.8477, GNorm = 0.2713, lr_0 = 9.5924e-04
Validation auc = 0.602682
Epoch 826
Validation auc = 0.609115
Epoch 827
Validation auc = 0.613531
Epoch 828
Validation auc = 0.613586
Epoch 829
Validation auc = 0.613204
Epoch 830
Loss = 2.6483e-03, PNorm = 106.8916, GNorm = 0.1011, lr_0 = 9.5899e-04
Validation auc = 0.612386
Epoch 831
Validation auc = 0.610533
Epoch 832
Validation auc = 0.610805
Epoch 833
Validation auc = 0.608297
Epoch 834
Loss = 6.5850e-02, PNorm = 106.9720, GNorm = 0.0700, lr_0 = 9.5877e-04
Loss = 1.9349e-03, PNorm = 106.9927, GNorm = 0.0480, lr_0 = 9.5875e-04
Validation auc = 0.566429
Epoch 835
Validation auc = 0.537153
Epoch 836
Validation auc = 0.537698
Epoch 837
Validation auc = 0.566483
Epoch 838
Validation auc = 0.590689
Epoch 839
Loss = 3.7882e-02, PNorm = 107.5055, GNorm = 0.3159, lr_0 = 9.5851e-04
Loss = 8.1030e-03, PNorm = 107.5374, GNorm = 0.2590, lr_0 = 9.5849e-04
Validation auc = 0.607371
Epoch 840
Validation auc = 0.613804
Epoch 841
Validation auc = 0.619310
Epoch 842
Validation auc = 0.622363
Epoch 843
Validation auc = 0.625579
Epoch 844
Loss = 2.2990e-02, PNorm = 107.8057, GNorm = 0.9043, lr_0 = 9.5827e-04
Validation auc = 0.628142
Epoch 845
Validation auc = 0.630104
Epoch 846
Validation auc = 0.634084
Epoch 847
Validation auc = 0.635774
Epoch 848
Validation auc = 0.633375
Epoch 849
Loss = 4.0735e-03, PNorm = 107.9705, GNorm = 0.0557, lr_0 = 9.5802e-04
Validation auc = 0.633757
Epoch 850
Validation auc = 0.637028
Epoch 851
Validation auc = 0.641117
Epoch 852
Validation auc = 0.639863
Epoch 853
Loss = 3.4650e-03, PNorm = 108.0663, GNorm = 0.0567, lr_0 = 9.5780e-04
Loss = 4.0874e-03, PNorm = 108.0728, GNorm = 0.1398, lr_0 = 9.5778e-04
Validation auc = 0.638772
Epoch 854
Validation auc = 0.638282
Epoch 855
Validation auc = 0.638936
Epoch 856
Validation auc = 0.638554
Epoch 857
Validation auc = 0.638118
Epoch 858
Loss = 1.6203e-02, PNorm = 108.1381, GNorm = 0.1321, lr_0 = 9.5754e-04
Validation auc = 0.639808
Epoch 859
Validation auc = 0.638772
Epoch 860
Validation auc = 0.632830
Epoch 861
Validation auc = 0.627814
Epoch 862
Validation auc = 0.622090
Epoch 863
Loss = 3.7915e-03, PNorm = 108.3285, GNorm = 0.1013, lr_0 = 9.5730e-04
Validation auc = 0.617947
Epoch 864
Validation auc = 0.623835
Epoch 865
Validation auc = 0.627051
Epoch 866
Validation auc = 0.628523
Epoch 867
Loss = 4.6345e-03, PNorm = 108.4429, GNorm = 0.0781, lr_0 = 9.5708e-04
Loss = 7.3670e-04, PNorm = 108.4488, GNorm = 0.0206, lr_0 = 9.5707e-04
Validation auc = 0.629068
Epoch 868
Validation auc = 0.624871
Epoch 869
Validation auc = 0.620564
Epoch 870
Validation auc = 0.619146
Epoch 871
Validation auc = 0.618710
Epoch 872
Loss = 5.7618e-04, PNorm = 108.5044, GNorm = 0.0107, lr_0 = 9.5683e-04
Loss = 3.2781e-05, PNorm = 108.5068, GNorm = 0.0010, lr_0 = 9.5681e-04
Validation auc = 0.620073
Epoch 873
Validation auc = 0.619800
Epoch 874
Validation auc = 0.621218
Epoch 875
Validation auc = 0.621818
Epoch 876
Validation auc = 0.623126
Epoch 877
Loss = 5.7221e-04, PNorm = 108.5477, GNorm = 0.0130, lr_0 = 9.5659e-04
Validation auc = 0.623835
Epoch 878
Validation auc = 0.625579
Epoch 879
Validation auc = 0.626615
Epoch 880
Validation auc = 0.627269
Epoch 881
Validation auc = 0.627215
Epoch 882
Loss = 1.3494e-03, PNorm = 108.5759, GNorm = 0.0264, lr_0 = 9.5634e-04
Validation auc = 0.626997
Epoch 883
Validation auc = 0.626670
Epoch 884
Validation auc = 0.626452
Epoch 885
Validation auc = 0.626833
Epoch 886
Loss = 1.8338e-03, PNorm = 108.5888, GNorm = 0.0800, lr_0 = 9.5612e-04
Loss = 2.9333e-04, PNorm = 108.5898, GNorm = 0.0065, lr_0 = 9.5610e-04
Validation auc = 0.626942
Epoch 887
Validation auc = 0.627324
Epoch 888
Validation auc = 0.627160
Epoch 889
Validation auc = 0.626424
Epoch 890
Validation auc = 0.626233
Epoch 891
Loss = 2.5756e-04, PNorm = 108.6022, GNorm = 0.0080, lr_0 = 9.5586e-04
Validation auc = 0.625770
Epoch 892
Validation auc = 0.623371
Epoch 893
Validation auc = 0.622526
Epoch 894
Validation auc = 0.621054
Epoch 895
Validation auc = 0.617402
Epoch 896
Loss = 5.6677e-04, PNorm = 108.6172, GNorm = 0.0157, lr_0 = 9.5563e-04
Validation auc = 0.616230
Epoch 897
Validation auc = 0.615821
Epoch 898
Validation auc = 0.614758
Epoch 899
Validation auc = 0.614185
Epoch 900
Loss = 3.7449e-04, PNorm = 108.6322, GNorm = 0.0068, lr_0 = 9.5541e-04
Loss = 1.1149e-04, PNorm = 108.6333, GNorm = 0.0036, lr_0 = 9.5539e-04
Validation auc = 0.613749
Epoch 901
Validation auc = 0.611896
Epoch 902
Validation auc = 0.609006
Epoch 903
Validation auc = 0.609061
Epoch 904
Validation auc = 0.610751
Epoch 905
Loss = 9.1077e-04, PNorm = 108.6679, GNorm = 0.0081, lr_0 = 9.5515e-04
Loss = 1.3555e-03, PNorm = 108.6707, GNorm = 0.0625, lr_0 = 9.5513e-04
Validation auc = 0.612604
Epoch 906
Validation auc = 0.613695
Epoch 907
Validation auc = 0.614785
Epoch 908
Validation auc = 0.616366
Epoch 909
Validation auc = 0.617184
Epoch 910
Loss = 1.6855e-04, PNorm = 108.6951, GNorm = 0.0047, lr_0 = 9.5491e-04
Validation auc = 0.617838
Epoch 911
Validation auc = 0.618874
Epoch 912
Validation auc = 0.619255
Epoch 913
Validation auc = 0.619691
Epoch 914
Validation auc = 0.619473
Epoch 915
Loss = 2.1484e-04, PNorm = 108.7083, GNorm = 0.0071, lr_0 = 9.5466e-04
Validation auc = 0.617184
Epoch 916
Validation auc = 0.614294
Epoch 917
Validation auc = 0.610969
Epoch 918
Validation auc = 0.606880
Epoch 919
Loss = 7.2648e-04, PNorm = 108.7354, GNorm = 0.0226, lr_0 = 9.5444e-04
Loss = 7.0200e-04, PNorm = 108.7379, GNorm = 0.0341, lr_0 = 9.5442e-04
Validation auc = 0.604100
Epoch 920
Validation auc = 0.601864
Epoch 921
Validation auc = 0.600120
Epoch 922
Validation auc = 0.599629
Epoch 923
Validation auc = 0.599248
Epoch 924
Loss = 3.2184e-02, PNorm = 108.7662, GNorm = 0.9996, lr_0 = 9.5419e-04
Validation auc = 0.604263
Epoch 925
Validation auc = 0.608461
Epoch 926
Validation auc = 0.611078
Epoch 927
Validation auc = 0.611787
Epoch 928
Validation auc = 0.610206
Epoch 929
Loss = 5.0626e-04, PNorm = 108.7860, GNorm = 0.0112, lr_0 = 9.5395e-04
Validation auc = 0.608625
Epoch 930
Validation auc = 0.607153
Epoch 931
Validation auc = 0.604590
Epoch 932
Validation auc = 0.603500
Epoch 933
Loss = 2.9101e-04, PNorm = 108.8012, GNorm = 0.0002, lr_0 = 9.5371e-04
Validation auc = 0.602955
Epoch 934
Validation auc = 0.602682
Epoch 935
Validation auc = 0.602083
Epoch 936
Validation auc = 0.601755
Epoch 937
Validation auc = 0.601537
Epoch 938
Loss = 1.1306e-04, PNorm = 108.8091, GNorm = 0.0012, lr_0 = 9.5348e-04
Loss = 1.8415e-04, PNorm = 108.8095, GNorm = 0.0068, lr_0 = 9.5346e-04
Validation auc = 0.601101
Epoch 939
Validation auc = 0.600611
Epoch 940
Validation auc = 0.600774
Epoch 941
Validation auc = 0.600338
Epoch 942
Validation auc = 0.600229
Epoch 943
Loss = 2.0877e-04, PNorm = 108.8188, GNorm = 0.0032, lr_0 = 9.5324e-04
Validation auc = 0.600174
Epoch 944
Validation auc = 0.599956
Epoch 945
Validation auc = 0.599847
Epoch 946
Validation auc = 0.599738
Epoch 947
Validation auc = 0.599847
Epoch 948
Loss = 3.2256e-03, PNorm = 108.8282, GNorm = 0.2217, lr_0 = 9.5299e-04
Validation auc = 0.599902
Epoch 949
Validation auc = 0.600556
Epoch 950
Validation auc = 0.601646
Epoch 951
Validation auc = 0.602410
Epoch 952
Loss = 5.2706e-04, PNorm = 108.8446, GNorm = 0.0054, lr_0 = 9.5277e-04
Loss = 1.5978e-03, PNorm = 108.8457, GNorm = 0.0561, lr_0 = 9.5275e-04
Validation auc = 0.603173
Epoch 953
Validation auc = 0.602846
Epoch 954
Validation auc = 0.603118
Epoch 955
Validation auc = 0.602900
Epoch 956
Validation auc = 0.602628
Epoch 957
Loss = 2.0868e-04, PNorm = 108.8607, GNorm = 0.0027, lr_0 = 9.5251e-04
Loss = 5.8532e-04, PNorm = 108.8615, GNorm = 0.0290, lr_0 = 9.5250e-04
Validation auc = 0.602791
Epoch 958
Validation auc = 0.602955
Epoch 959
Validation auc = 0.602628
Epoch 960
Validation auc = 0.602628
Epoch 961
Validation auc = 0.602791
Epoch 962
Loss = 2.1708e-04, PNorm = 108.8685, GNorm = 0.0034, lr_0 = 9.5228e-04
Validation auc = 0.603118
Epoch 963
Validation auc = 0.603554
Epoch 964
Validation auc = 0.603664
Epoch 965
Validation auc = 0.603718
Epoch 966
Loss = 3.8164e-03, PNorm = 108.8832, GNorm = 0.0021, lr_0 = 9.5204e-04
Validation auc = 0.603009
Epoch 967
Validation auc = 0.602900
Epoch 968
Validation auc = 0.602791
Epoch 969
Validation auc = 0.602737
Epoch 970
Validation auc = 0.602573
Epoch 971
Loss = 1.7709e-04, PNorm = 108.8955, GNorm = 0.0054, lr_0 = 9.5180e-04
Loss = 3.4530e-02, PNorm = 108.9017, GNorm = 2.1681, lr_0 = 9.5179e-04
Validation auc = 0.605408
Epoch 972
Validation auc = 0.610642
Epoch 973
Validation auc = 0.616638
Epoch 974
Validation auc = 0.621872
Epoch 975
Validation auc = 0.624434
Epoch 976
Loss = 1.1973e-03, PNorm = 108.9590, GNorm = 0.0285, lr_0 = 9.5157e-04
Validation auc = 0.627269
Epoch 977
Validation auc = 0.627160
Epoch 978
Validation auc = 0.626233
Epoch 979
Validation auc = 0.621927
Epoch 980
Validation auc = 0.618165
Epoch 981
Loss = 6.1911e-04, PNorm = 109.0086, GNorm = 0.0158, lr_0 = 9.5132e-04
Validation auc = 0.615548
Epoch 982
Validation auc = 0.614458
Epoch 983
Validation auc = 0.614022
Epoch 984
Validation auc = 0.613913
Epoch 985
Loss = 6.8648e-04, PNorm = 109.0426, GNorm = 0.0326, lr_0 = 9.5110e-04
Loss = 5.1352e-04, PNorm = 109.0445, GNorm = 0.0228, lr_0 = 9.5108e-04
Validation auc = 0.613422
Epoch 986
Validation auc = 0.613749
Epoch 987
Validation auc = 0.615167
Epoch 988
Validation auc = 0.615821
Epoch 989
Validation auc = 0.616311
Epoch 990
Loss = 1.7064e-04, PNorm = 109.0638, GNorm = 0.0031, lr_0 = 9.5084e-04
Loss = 1.5366e-04, PNorm = 109.0645, GNorm = 0.0060, lr_0 = 9.5083e-04
Validation auc = 0.616584
Epoch 991
Validation auc = 0.617184
Epoch 992
Validation auc = 0.618656
Epoch 993
Validation auc = 0.618110
Epoch 994
Validation auc = 0.620346
Epoch 995
Loss = 9.3962e-04, PNorm = 109.0785, GNorm = 0.0201, lr_0 = 9.5061e-04
Validation auc = 0.623235
Epoch 996
Validation auc = 0.625034
Epoch 997
Validation auc = 0.627160
Epoch 998
Validation auc = 0.629177
Epoch 999
Loss = 4.0199e-03, PNorm = 109.1057, GNorm = 0.1198, lr_0 = 9.5037e-04
Validation auc = 0.630268
Epoch 1000
Validation auc = 0.629886
Epoch 1001
Validation auc = 0.629777
Epoch 1002
Validation auc = 0.630377
Epoch 1003
Validation auc = 0.631249
Epoch 1004
Loss = 1.2131e-04, PNorm = 109.1300, GNorm = 0.0027, lr_0 = 9.5014e-04
Loss = 2.2097e-04, PNorm = 109.1310, GNorm = 0.0055, lr_0 = 9.5012e-04
Validation auc = 0.632557
Epoch 1005
Validation auc = 0.631740
Epoch 1006
Validation auc = 0.632448
Epoch 1007
Validation auc = 0.632557
Epoch 1008
Validation auc = 0.632176
Epoch 1009
Loss = 2.9862e-03, PNorm = 109.1437, GNorm = 0.1385, lr_0 = 9.4990e-04
Validation auc = 0.632557
Epoch 1010
Validation auc = 0.633648
Epoch 1011
Validation auc = 0.634193
Epoch 1012
Validation auc = 0.634029
Epoch 1013
Validation auc = 0.634902
Epoch 1014
Loss = 4.0994e-04, PNorm = 109.1522, GNorm = 0.0105, lr_0 = 9.4965e-04
Validation auc = 0.635774
Epoch 1015
Validation auc = 0.636265
Epoch 1016
Validation auc = 0.636537
Epoch 1017
Validation auc = 0.636428
Epoch 1018
Loss = 1.5317e-04, PNorm = 109.1573, GNorm = 0.0073, lr_0 = 9.4943e-04
Loss = 9.1588e-05, PNorm = 109.1577, GNorm = 0.0027, lr_0 = 9.4941e-04
Validation auc = 0.636483
Epoch 1019
Validation auc = 0.636428
Epoch 1020
Validation auc = 0.640053
Epoch 1021
Validation auc = 0.645614
Epoch 1022
Validation auc = 0.646350
Epoch 1023
Loss = 1.5476e-03, PNorm = 109.1585, GNorm = 0.0112, lr_0 = 9.4918e-04
Loss = 1.2126e-03, PNorm = 109.1595, GNorm = 0.0346, lr_0 = 9.4916e-04
Validation auc = 0.645151
Epoch 1024
Validation auc = 0.643788
Epoch 1025
Validation auc = 0.641934
Epoch 1026
Validation auc = 0.639208
Epoch 1027
Validation auc = 0.637137
Epoch 1028
Loss = 1.2721e-03, PNorm = 109.1803, GNorm = 0.0646, lr_0 = 9.4894e-04
Validation auc = 0.635556
Epoch 1029
Validation auc = 0.634738
Epoch 1030
Validation auc = 0.633920
Epoch 1031
Validation auc = 0.632884
Epoch 1032
Validation auc = 0.631958
Epoch 1033
Loss = 4.0507e-04, PNorm = 109.2003, GNorm = 0.0056, lr_0 = 9.4869e-04
Validation auc = 0.631903
Epoch 1034
Validation auc = 0.633103
Epoch 1035
Validation auc = 0.633975
Epoch 1036
Validation auc = 0.633757
Epoch 1037
Loss = 5.0984e-04, PNorm = 109.2174, GNorm = 0.0316, lr_0 = 9.4847e-04
Loss = 1.6074e-04, PNorm = 109.2184, GNorm = 0.0059, lr_0 = 9.4845e-04
Validation auc = 0.634302
Epoch 1038
Validation auc = 0.634574
Epoch 1039
Validation auc = 0.635065
Epoch 1040
Validation auc = 0.635283
Epoch 1041
Validation auc = 0.634574
Epoch 1042
Loss = 2.3332e-04, PNorm = 109.2287, GNorm = 0.0048, lr_0 = 9.4823e-04
Validation auc = 0.634138
Epoch 1043
Validation auc = 0.634520
Epoch 1044
Validation auc = 0.634356
Epoch 1045
Validation auc = 0.633975
Epoch 1046
Validation auc = 0.633484
Epoch 1047
Loss = 2.5242e-03, PNorm = 109.2436, GNorm = 0.0761, lr_0 = 9.4798e-04
Validation auc = 0.631849
Epoch 1048
Validation auc = 0.630758
Epoch 1049
Validation auc = 0.630213
Epoch 1050
Validation auc = 0.629014
Epoch 1051
Loss = 2.9661e-04, PNorm = 109.2692, GNorm = 0.0056, lr_0 = 9.4776e-04
Loss = 9.9457e-05, PNorm = 109.2710, GNorm = 0.0028, lr_0 = 9.4775e-04
Validation auc = 0.626888
Epoch 1052
Validation auc = 0.624761
Epoch 1053
Validation auc = 0.624489
Epoch 1054
Validation auc = 0.623399
Epoch 1055
Validation auc = 0.623344
Epoch 1056
Loss = 7.9943e-05, PNorm = 109.2890, GNorm = 0.0084, lr_0 = 9.4751e-04
Loss = 2.7973e-05, PNorm = 109.2898, GNorm = 0.0009, lr_0 = 9.4749e-04
Validation auc = 0.622908
Epoch 1057
Validation auc = 0.622799
Epoch 1058
Validation auc = 0.624434
Epoch 1059
Validation auc = 0.627215
Epoch 1060
Validation auc = 0.629613
Epoch 1061
Loss = 1.3592e-04, PNorm = 109.2995, GNorm = 0.0043, lr_0 = 9.4728e-04
Validation auc = 0.630104
Epoch 1062
Validation auc = 0.631140
Epoch 1063
Validation auc = 0.630104
Epoch 1064
Validation auc = 0.629941
Epoch 1065
Validation auc = 0.629014
Epoch 1066
Loss = 1.2878e-04, PNorm = 109.3093, GNorm = 0.0019, lr_0 = 9.4702e-04
Validation auc = 0.628632
Epoch 1067
Validation auc = 0.628469
Epoch 1068
Validation auc = 0.628032
Epoch 1069
Validation auc = 0.627487
Epoch 1070
Loss = 1.6063e-04, PNorm = 109.3169, GNorm = 0.0008, lr_0 = 9.4681e-04
Loss = 6.5365e-06, PNorm = 109.3174, GNorm = 0.0004, lr_0 = 9.4679e-04
Validation auc = 0.627215
Epoch 1071
Validation auc = 0.627215
Epoch 1072
Validation auc = 0.627160
Epoch 1073
Validation auc = 0.626942
Epoch 1074
Validation auc = 0.626342
Epoch 1075
Loss = 6.8349e-05, PNorm = 109.3212, GNorm = 0.0016, lr_0 = 9.4657e-04
Validation auc = 0.625034
Epoch 1076
Validation auc = 0.627705
Epoch 1077
Validation auc = 0.628796
Epoch 1078
Validation auc = 0.629341
Epoch 1079
Validation auc = 0.630104
Epoch 1080
Loss = 6.5138e-05, PNorm = 109.3252, GNorm = 0.0011, lr_0 = 9.4632e-04
Validation auc = 0.629777
Epoch 1081
Validation auc = 0.632012
Epoch 1082
Validation auc = 0.633757
Epoch 1083
Validation auc = 0.635665
Epoch 1084
Loss = 1.9119e-04, PNorm = 109.3342, GNorm = 0.0028, lr_0 = 9.4610e-04
Loss = 2.7254e-04, PNorm = 109.3350, GNorm = 0.0160, lr_0 = 9.4608e-04
Validation auc = 0.635937
Epoch 1085
Validation auc = 0.636319
Epoch 1086
Validation auc = 0.636155
Epoch 1087
Validation auc = 0.635774
Epoch 1088
Validation auc = 0.635120
Epoch 1089
Loss = 1.1053e-03, PNorm = 109.3462, GNorm = 0.0038, lr_0 = 9.4585e-04
Loss = 2.5062e-04, PNorm = 109.3470, GNorm = 0.0063, lr_0 = 9.4583e-04
Validation auc = 0.632775
Epoch 1090
Validation auc = 0.628142
Epoch 1091
Validation auc = 0.623944
Epoch 1092
Validation auc = 0.617129
Epoch 1093
Validation auc = 0.610751
Epoch 1094
Loss = 2.9683e-05, PNorm = 109.3590, GNorm = 0.0009, lr_0 = 9.4561e-04
Validation auc = 0.604917
Epoch 1095
Validation auc = 0.599738
Epoch 1096
Validation auc = 0.595759
Epoch 1097
Validation auc = 0.600174
Epoch 1098
Validation auc = 0.608570
Epoch 1099
Loss = 2.1165e-05, PNorm = 109.3718, GNorm = 0.0008, lr_0 = 9.4536e-04
Validation auc = 0.612495
Epoch 1100
Validation auc = 0.616093
Epoch 1101
Validation auc = 0.617020
Epoch 1102
Validation auc = 0.618601
Epoch 1103
Loss = 9.2153e-05, PNorm = 109.3809, GNorm = 0.0056, lr_0 = 9.4515e-04
Loss = 1.0371e-05, PNorm = 109.3814, GNorm = 0.0007, lr_0 = 9.4513e-04
Validation auc = 0.619528
Epoch 1104
Validation auc = 0.619855
Epoch 1105
Validation auc = 0.620455
Epoch 1106
Validation auc = 0.620182
Epoch 1107
Validation auc = 0.619964
Epoch 1108
Loss = 4.3879e-05, PNorm = 109.3869, GNorm = 0.0012, lr_0 = 9.4489e-04
Validation auc = 0.620073
Epoch 1109
Validation auc = 0.619800
Epoch 1110
Validation auc = 0.619800
Epoch 1111
Validation auc = 0.619037
Epoch 1112
Validation auc = 0.618165
Epoch 1113
Loss = 1.3734e-04, PNorm = 109.3903, GNorm = 0.0086, lr_0 = 9.4466e-04
Validation auc = 0.617347
Epoch 1114
Validation auc = 0.617347
Epoch 1115
Validation auc = 0.619746
Epoch 1116
Validation auc = 0.622472
Epoch 1117
Loss = 6.3375e-05, PNorm = 109.4109, GNorm = 0.0013, lr_0 = 9.4444e-04
Loss = 9.2290e-05, PNorm = 109.4125, GNorm = 0.0053, lr_0 = 9.4443e-04
Validation auc = 0.623562
Epoch 1118
Validation auc = 0.624162
Epoch 1119
Validation auc = 0.625525
Epoch 1120
Validation auc = 0.625906
Epoch 1121
Validation auc = 0.624216
Epoch 1122
Loss = 1.9032e-04, PNorm = 109.4264, GNorm = 0.0043, lr_0 = 9.4419e-04
Loss = 3.6557e-06, PNorm = 109.4271, GNorm = 0.0002, lr_0 = 9.4417e-04
Validation auc = 0.623508
Epoch 1123
Validation auc = 0.621818
Epoch 1124
Validation auc = 0.620618
Epoch 1125
Validation auc = 0.622417
Epoch 1126
Validation auc = 0.623562
Epoch 1127
Loss = 8.3190e-05, PNorm = 109.4335, GNorm = 0.0015, lr_0 = 9.4396e-04
Validation auc = 0.624162
Epoch 1128
Validation auc = 0.624107
Epoch 1129
Validation auc = 0.625361
Epoch 1130
Validation auc = 0.626506
Epoch 1131
Validation auc = 0.628196
Epoch 1132
Loss = 3.0539e-05, PNorm = 109.4402, GNorm = 0.0007, lr_0 = 9.4371e-04
Validation auc = 0.628578
Epoch 1133
Validation auc = 0.640517
Epoch 1134
Validation auc = 0.632067
Epoch 1135
Validation auc = 0.543913
Epoch 1136
Loss = 2.1671e-01, PNorm = 109.8904, GNorm = 2.1467, lr_0 = 9.4349e-04
Loss = 9.1459e-01, PNorm = 109.9589, GNorm = 24.2821, lr_0 = 9.4347e-04
Validation auc = 0.577877
Epoch 1137
Validation auc = 0.571117
Epoch 1138
Validation auc = 0.608516
Epoch 1139
Validation auc = 0.611350
Epoch 1140
Validation auc = 0.604045
Epoch 1141
Loss = 2.1503e-01, PNorm = 111.5514, GNorm = 1.2422, lr_0 = 9.4324e-04
Validation auc = 0.548111
Epoch 1142
Validation auc = 0.595650
Epoch 1143
Validation auc = 0.622417
Epoch 1144
Validation auc = 0.629395
Epoch 1145
Validation auc = 0.631958
Epoch 1146
Loss = 1.8257e-01, PNorm = 112.8050, GNorm = 3.0340, lr_0 = 9.4300e-04
Validation auc = 0.640517
Epoch 1147
Validation auc = 0.641771
Epoch 1148
Validation auc = 0.648149
Epoch 1149
Validation auc = 0.654310
Epoch 1150
Loss = 4.6320e-02, PNorm = 113.5831, GNorm = 0.6064, lr_0 = 9.4279e-04
Loss = 1.9343e-01, PNorm = 113.6268, GNorm = 5.3259, lr_0 = 9.4277e-04
Validation auc = 0.644224
Epoch 1151
Validation auc = 0.612386
Epoch 1152
Validation auc = 0.581802
Epoch 1153
Validation auc = 0.600992
Epoch 1154
Validation auc = 0.610751
Epoch 1155
Loss = 2.2474e-01, PNorm = 114.2918, GNorm = 1.4269, lr_0 = 9.4253e-04
Loss = 2.0427e-02, PNorm = 114.3453, GNorm = 0.7588, lr_0 = 9.4252e-04
Validation auc = 0.605790
Epoch 1156
Validation auc = 0.638609
Epoch 1157
Validation auc = 0.668375
Epoch 1158
Validation auc = 0.685984
Epoch 1159
Validation auc = 0.653165
Epoch 1160
Loss = 1.3696e-01, PNorm = 114.9980, GNorm = 1.4180, lr_0 = 9.4230e-04
Validation auc = 0.649349
Epoch 1161
Validation auc = 0.610424
Epoch 1162
Validation auc = 0.585346
Epoch 1163
Validation auc = 0.574061
Epoch 1164
Validation auc = 0.592542
Epoch 1165
Loss = 4.2600e-02, PNorm = 115.8176, GNorm = 0.6369, lr_0 = 9.4205e-04
Validation auc = 0.607970
Epoch 1166
Validation auc = 0.618001
Epoch 1167
Validation auc = 0.606117
Epoch 1168
Validation auc = 0.603991
Epoch 1169
Loss = 3.2256e-02, PNorm = 116.4463, GNorm = 0.2490, lr_0 = 9.4183e-04
Loss = 5.3521e-03, PNorm = 116.4887, GNorm = 0.1684, lr_0 = 9.4182e-04
Validation auc = 0.607643
Epoch 1170
Validation auc = 0.611514
Epoch 1171
Validation auc = 0.621109
Epoch 1172
Validation auc = 0.627978
Epoch 1173
Validation auc = 0.630268
Epoch 1174
Loss = 5.1332e-02, PNorm = 116.9846, GNorm = 1.1814, lr_0 = 9.4158e-04
Validation auc = 0.637627
Epoch 1175
Validation auc = 0.639645
Epoch 1176
Validation auc = 0.643243
Epoch 1177
Validation auc = 0.641335
Epoch 1178
Validation auc = 0.634902
Epoch 1179
Loss = 9.3116e-03, PNorm = 117.2712, GNorm = 0.2608, lr_0 = 9.4135e-04
Validation auc = 0.632339
Epoch 1180
Validation auc = 0.635447
Epoch 1181
Validation auc = 0.636919
Epoch 1182
Validation auc = 0.640517
Epoch 1183
Loss = 3.0744e-03, PNorm = 117.4552, GNorm = 0.0181, lr_0 = 9.4112e-04
Validation auc = 0.646732
Epoch 1184
Validation auc = 0.650548
Epoch 1185
Validation auc = 0.653546
Epoch 1186
Validation auc = 0.652074
Epoch 1187
Validation auc = 0.653383
Epoch 1188
Loss = 4.8903e-02, PNorm = 117.5533, GNorm = 0.9789, lr_0 = 9.4088e-04
Loss = 3.9453e-04, PNorm = 117.5586, GNorm = 0.0137, lr_0 = 9.4087e-04
Validation auc = 0.654419
Epoch 1189
Validation auc = 0.655127
Epoch 1190
Validation auc = 0.660906
Epoch 1191
Validation auc = 0.660688
Epoch 1192
Validation auc = 0.659271
Epoch 1193
Loss = 4.9882e-03, PNorm = 117.6440, GNorm = 0.0624, lr_0 = 9.4065e-04
Validation auc = 0.658126
Epoch 1194
Validation auc = 0.657417
Epoch 1195
Validation auc = 0.658344
Epoch 1196
Validation auc = 0.665049
Epoch 1197
Validation auc = 0.677043
Epoch 1198
Loss = 3.0363e-03, PNorm = 117.7511, GNorm = 0.0762, lr_0 = 9.4040e-04
Validation auc = 0.684839
Epoch 1199
Validation auc = 0.690618
Epoch 1200
Validation auc = 0.695906
Epoch 1201
Validation auc = 0.700758
Epoch 1202
Loss = 2.3239e-03, PNorm = 117.8581, GNorm = 0.0507, lr_0 = 9.4018e-04
Loss = 4.3464e-02, PNorm = 117.8671, GNorm = 1.7734, lr_0 = 9.4016e-04
Validation auc = 0.697923
Epoch 1203
Validation auc = 0.686420
Epoch 1204
Validation auc = 0.681186
Epoch 1205
Validation auc = 0.664341
Epoch 1206
Validation auc = 0.659925
Epoch 1207
Loss = 1.0201e-02, PNorm = 118.0634, GNorm = 0.1656, lr_0 = 9.3993e-04
Loss = 7.6717e-05, PNorm = 118.0764, GNorm = 0.0040, lr_0 = 9.3991e-04
Validation auc = 0.657908
Epoch 1208
Validation auc = 0.657853
Epoch 1209
Validation auc = 0.655781
Epoch 1210
Validation auc = 0.650166
Epoch 1211
Validation auc = 0.659380
Epoch 1212
Loss = 1.1624e-01, PNorm = 118.3304, GNorm = 0.6241, lr_0 = 9.3970e-04
Validation auc = 0.666085
Epoch 1213
Validation auc = 0.668647
Epoch 1214
Validation auc = 0.670174
Epoch 1215
Validation auc = 0.676225
Epoch 1216
Loss = 4.8010e-02, PNorm = 118.7454, GNorm = 0.1794, lr_0 = 9.3946e-04
Validation auc = 0.677098
Epoch 1217
Validation auc = 0.671755
Epoch 1218
Validation auc = 0.673281
Epoch 1219
Validation auc = 0.669084
Epoch 1220
Validation auc = 0.660034
Epoch 1221
Loss = 2.7046e-02, PNorm = 118.9591, GNorm = 0.1906, lr_0 = 9.3923e-04
Loss = 6.8608e-04, PNorm = 118.9706, GNorm = 0.0424, lr_0 = 9.3922e-04
Validation auc = 0.654201
Epoch 1222
Validation auc = 0.636919
Epoch 1223
Validation auc = 0.620509
Epoch 1224
Validation auc = 0.610860
Epoch 1225
Validation auc = 0.601483
Epoch 1226
Loss = 5.8880e-02, PNorm = 119.0891, GNorm = 0.9136, lr_0 = 9.3900e-04
Validation auc = 0.602628
Epoch 1227
Validation auc = 0.609442
Epoch 1228
Validation auc = 0.615548
Epoch 1229
Validation auc = 0.629341
Epoch 1230
Validation auc = 0.628687
Epoch 1231
Loss = 1.4494e-02, PNorm = 119.2087, GNorm = 0.1620, lr_0 = 9.3875e-04
Validation auc = 0.628142
Epoch 1232
Validation auc = 0.628959
Epoch 1233
Validation auc = 0.632557
Epoch 1234
Validation auc = 0.625525
Epoch 1235
Loss = 1.7058e-02, PNorm = 119.3658, GNorm = 0.0934, lr_0 = 9.3853e-04
Loss = 5.4513e-02, PNorm = 119.3777, GNorm = 1.0673, lr_0 = 9.3852e-04
Validation auc = 0.620727
Epoch 1236
Validation auc = 0.622526
Epoch 1237
Validation auc = 0.632666
Epoch 1238
Validation auc = 0.639372
Epoch 1239
Validation auc = 0.643297
Epoch 1240
Loss = 4.4400e-02, PNorm = 119.5931, GNorm = 0.9653, lr_0 = 9.3828e-04
Loss = 4.0884e-05, PNorm = 119.6082, GNorm = 0.0024, lr_0 = 9.3827e-04
Validation auc = 0.639972
Epoch 1241
Validation auc = 0.636428
Epoch 1242
Validation auc = 0.632503
Epoch 1243
Validation auc = 0.628578
Epoch 1244
Validation auc = 0.627596
Epoch 1245
Loss = 7.5333e-03, PNorm = 119.7547, GNorm = 0.3238, lr_0 = 9.3805e-04
Validation auc = 0.628087
Epoch 1246
Validation auc = 0.627160
Epoch 1247
Validation auc = 0.626452
Epoch 1248
Validation auc = 0.624652
Epoch 1249
Loss = 2.4452e-03, PNorm = 119.8453, GNorm = 0.0590, lr_0 = 9.3782e-04
Validation auc = 0.625416
Epoch 1250
Validation auc = 0.624980
Epoch 1251
Validation auc = 0.623453
Epoch 1252
Validation auc = 0.622853
Epoch 1253
Validation auc = 0.622145
Epoch 1254
Loss = 1.2058e-03, PNorm = 119.8922, GNorm = 0.0528, lr_0 = 9.3758e-04
Loss = 2.5244e-02, PNorm = 119.8953, GNorm = 0.3295, lr_0 = 9.3757e-04
Validation auc = 0.621981
Epoch 1255
Validation auc = 0.621218
Epoch 1256
Validation auc = 0.620782
Epoch 1257
Validation auc = 0.620891
Epoch 1258
Validation auc = 0.620782
Epoch 1259
Loss = 5.6554e-04, PNorm = 119.9237, GNorm = 0.0084, lr_0 = 9.3735e-04
Validation auc = 0.620182
Epoch 1260
Validation auc = 0.618983
Epoch 1261
Validation auc = 0.616093
Epoch 1262
Validation auc = 0.614240
Epoch 1263
Validation auc = 0.611296
Epoch 1264
Loss = 9.4883e-04, PNorm = 119.9622, GNorm = 0.0231, lr_0 = 9.3710e-04
Validation auc = 0.610315
Epoch 1265
Validation auc = 0.610042
Epoch 1266
Validation auc = 0.611241
Epoch 1267
Validation auc = 0.612604
Epoch 1268
Loss = 6.8845e-04, PNorm = 120.0146, GNorm = 0.0159, lr_0 = 9.3689e-04
Loss = 3.5223e-05, PNorm = 120.0172, GNorm = 0.0024, lr_0 = 9.3687e-04
Validation auc = 0.613040
Epoch 1269
Validation auc = 0.614022
Epoch 1270
Validation auc = 0.614621
Epoch 1271
Validation auc = 0.615003
Epoch 1272
Validation auc = 0.614839
Epoch 1273
Loss = 3.4032e-04, PNorm = 120.0397, GNorm = 0.0328, lr_0 = 9.3664e-04
Loss = 6.9538e-06, PNorm = 120.0405, GNorm = 0.0004, lr_0 = 9.3662e-04
Validation auc = 0.614676
Epoch 1274
Validation auc = 0.614512
Epoch 1275
Validation auc = 0.613858
Epoch 1276
Validation auc = 0.613422
Epoch 1277
Validation auc = 0.614730
Epoch 1278
Loss = 7.7746e-04, PNorm = 120.0579, GNorm = 0.0175, lr_0 = 9.3641e-04
Validation auc = 0.617838
Epoch 1279
Validation auc = 0.611514
Epoch 1280
Validation auc = 0.607752
Epoch 1281
Validation auc = 0.603227
Epoch 1282
Validation auc = 0.599411
Epoch 1283
Loss = 6.7284e-04, PNorm = 120.0930, GNorm = 0.0608, lr_0 = 9.3616e-04
Validation auc = 0.597558
Epoch 1284
Validation auc = 0.598048
Epoch 1285
Validation auc = 0.597449
Epoch 1286
Validation auc = 0.596249
Epoch 1287
Loss = 7.7003e-03, PNorm = 120.1415, GNorm = 0.0531, lr_0 = 9.3594e-04
Loss = 1.2120e-06, PNorm = 120.1443, GNorm = 0.0001, lr_0 = 9.3592e-04
Validation auc = 0.595977
Epoch 1288
Validation auc = 0.595104
Epoch 1289
Validation auc = 0.593469
Epoch 1290
Validation auc = 0.589544
Epoch 1291
Validation auc = 0.584746
Epoch 1292
Loss = 1.9580e-02, PNorm = 120.2585, GNorm = 0.6608, lr_0 = 9.3571e-04
Validation auc = 0.589544
Epoch 1293
Validation auc = 0.579567
Epoch 1294
Validation auc = 0.556343
Epoch 1295
Validation auc = 0.582457
Epoch 1296
Validation auc = 0.592651
Epoch 1297
Loss = 3.8507e-02, PNorm = 121.1611, GNorm = 0.8244, lr_0 = 9.3546e-04
Validation auc = 0.591506
Epoch 1298
Validation auc = 0.608570
Epoch 1299
Validation auc = 0.628251
Epoch 1300
Validation auc = 0.630486
Epoch 1301
Loss = 7.1549e-02, PNorm = 121.7943, GNorm = 0.4940, lr_0 = 9.3524e-04
Loss = 9.9208e-04, PNorm = 121.8364, GNorm = 0.0285, lr_0 = 9.3523e-04
Validation auc = 0.618492
Epoch 1302
Validation auc = 0.606389
Epoch 1303
Validation auc = 0.600338
Epoch 1304
Validation auc = 0.596249
Epoch 1305
Validation auc = 0.585455
Epoch 1306
Loss = 8.6555e-02, PNorm = 122.2979, GNorm = 0.7406, lr_0 = 9.3499e-04
Loss = 4.7876e-04, PNorm = 122.3266, GNorm = 0.0266, lr_0 = 9.3498e-04
Validation auc = 0.584692
Epoch 1307
Validation auc = 0.601047
Epoch 1308
Validation auc = 0.618601
Epoch 1309
Validation auc = 0.634247
Epoch 1310
Validation auc = 0.635283
Epoch 1311
Loss = 2.0442e-02, PNorm = 122.6248, GNorm = 0.2743, lr_0 = 9.3476e-04
Validation auc = 0.631467
Epoch 1312
Validation auc = 0.630704
Epoch 1313
Validation auc = 0.631085
Epoch 1314
Validation auc = 0.641662
Epoch 1315
Validation auc = 0.638500
Epoch 1316
Loss = 1.6153e-02, PNorm = 122.8717, GNorm = 0.2444, lr_0 = 9.3451e-04
Validation auc = 0.626779
Epoch 1317
Validation auc = 0.638009
Epoch 1318
Validation auc = 0.640026
Epoch 1319
Validation auc = 0.642697
Epoch 1320
Loss = 1.5007e-02, PNorm = 123.0294, GNorm = 0.4233, lr_0 = 9.3430e-04
Loss = 8.5351e-01, PNorm = 123.0388, GNorm = 8.3374, lr_0 = 9.3428e-04
Validation auc = 0.644551
Epoch 1321
Validation auc = 0.633975
Epoch 1322
Validation auc = 0.626179
Epoch 1323
Validation auc = 0.615058
Epoch 1324
Validation auc = 0.604318
Epoch 1325
Loss = 1.6442e-02, PNorm = 123.2980, GNorm = 0.3476, lr_0 = 9.3407e-04
Validation auc = 0.589925
Epoch 1326
Validation auc = 0.581530
Epoch 1327
Validation auc = 0.576187
Epoch 1328
Validation auc = 0.575696
Epoch 1329
Validation auc = 0.580603
Epoch 1330
Loss = 4.4436e-03, PNorm = 123.5728, GNorm = 0.1533, lr_0 = 9.3382e-04
Validation auc = 0.585455
Epoch 1331
Validation auc = 0.590961
Epoch 1332
Validation auc = 0.592488
Epoch 1333
Validation auc = 0.592270
Epoch 1334
Loss = 3.3712e-02, PNorm = 123.7077, GNorm = 1.0435, lr_0 = 9.3360e-04
Loss = 1.1620e-02, PNorm = 123.7197, GNorm = 0.3387, lr_0 = 9.3359e-04
Validation auc = 0.592215
Epoch 1335
Validation auc = 0.585455
Epoch 1336
Validation auc = 0.578804
Epoch 1337
Validation auc = 0.578150
Epoch 1338
Validation auc = 0.581639
Epoch 1339
Loss = 7.6760e-03, PNorm = 123.8980, GNorm = 0.0957, lr_0 = 9.3336e-04
Loss = 1.3432e-02, PNorm = 123.9124, GNorm = 0.2037, lr_0 = 9.3334e-04
Validation auc = 0.585837
Epoch 1340
Validation auc = 0.587309
Epoch 1341
Validation auc = 0.589816
Epoch 1342
Validation auc = 0.589925
Epoch 1343
Validation auc = 0.590580
Epoch 1344
Loss = 1.5951e-03, PNorm = 124.0411, GNorm = 0.0242, lr_0 = 9.3312e-04
Validation auc = 0.591561
Epoch 1345
Validation auc = 0.593414
Epoch 1346
Validation auc = 0.596004
Epoch 1347
Validation auc = 0.599002
Epoch 1348
Validation auc = 0.602328
Epoch 1349
Loss = 2.1579e-03, PNorm = 124.1012, GNorm = 0.0345, lr_0 = 9.3288e-04
Validation auc = 0.605544
Epoch 1350
Validation auc = 0.607234
Epoch 1351
Validation auc = 0.609306
Epoch 1352
Validation auc = 0.614649
Epoch 1353
Loss = 1.8866e-03, PNorm = 124.1448, GNorm = 0.0268, lr_0 = 9.3266e-04
Loss = 9.0545e-05, PNorm = 124.1476, GNorm = 0.0039, lr_0 = 9.3264e-04
Validation auc = 0.615793
Epoch 1354
Validation auc = 0.616584
Epoch 1355
Validation auc = 0.619037
Epoch 1356
Validation auc = 0.621518
Epoch 1357
Validation auc = 0.623698
Epoch 1358
Loss = 2.3698e-03, PNorm = 124.1859, GNorm = 0.0411, lr_0 = 9.3241e-04
Validation auc = 0.623644
Epoch 1359
Validation auc = 0.621218
Epoch 1360
Validation auc = 0.615439
Epoch 1361
Validation auc = 0.600720
Epoch 1362
Validation auc = 0.604427
Epoch 1363
Loss = 1.3775e-01, PNorm = 124.3130, GNorm = 0.4630, lr_0 = 9.3218e-04
Validation auc = 0.604318
Epoch 1364
Validation auc = 0.606607
Epoch 1365
Validation auc = 0.615058
Epoch 1366
Validation auc = 0.618110
Epoch 1367
Loss = 1.1820e-02, PNorm = 124.5062, GNorm = 0.1490, lr_0 = 9.3197e-04
Loss = 4.4098e-02, PNorm = 124.5161, GNorm = 1.9320, lr_0 = 9.3195e-04
Validation auc = 0.615221
Epoch 1368
Validation auc = 0.611732
Epoch 1369
Validation auc = 0.610969
Epoch 1370
Validation auc = 0.612441
Epoch 1371
Validation auc = 0.613586
Epoch 1372
Loss = 1.0956e-02, PNorm = 124.6464, GNorm = 0.2824, lr_0 = 9.3172e-04
Loss = 7.0879e-04, PNorm = 124.6527, GNorm = 0.0168, lr_0 = 9.3170e-04
Validation auc = 0.614567
Epoch 1373
Validation auc = 0.617347
Epoch 1374
Validation auc = 0.621763
Epoch 1375
Validation auc = 0.622526
Epoch 1376
Validation auc = 0.624598
Epoch 1377
Loss = 2.5343e-03, PNorm = 124.7135, GNorm = 0.0605, lr_0 = 9.3149e-04
Validation auc = 0.627215
Epoch 1378
Validation auc = 0.628469
Epoch 1379
Validation auc = 0.631085
Epoch 1380
Validation auc = 0.635011
Epoch 1381
Validation auc = 0.636319
Epoch 1382
Loss = 5.4917e-03, PNorm = 124.7523, GNorm = 0.0873, lr_0 = 9.3124e-04
Validation auc = 0.637627
Epoch 1383
Validation auc = 0.640898
Epoch 1384
Validation auc = 0.642970
Epoch 1385
Validation auc = 0.643624
Epoch 1386
Loss = 1.8434e-03, PNorm = 124.7747, GNorm = 0.0090, lr_0 = 9.3102e-04
Loss = 1.1642e-03, PNorm = 124.7761, GNorm = 0.0264, lr_0 = 9.3101e-04
Validation auc = 0.644933
Epoch 1387
Validation auc = 0.645369
Epoch 1388
Validation auc = 0.648313
Epoch 1389
Validation auc = 0.651093
Epoch 1390
Validation auc = 0.651148
Epoch 1391
Loss = 8.8950e-03, PNorm = 124.7987, GNorm = 0.1597, lr_0 = 9.3078e-04
Validation auc = 0.653110
Epoch 1392
Validation auc = 0.653819
Epoch 1393
Validation auc = 0.653928
Epoch 1394
Validation auc = 0.653601
Epoch 1395
Validation auc = 0.652510
Epoch 1396
Loss = 1.0699e-03, PNorm = 124.8349, GNorm = 0.0163, lr_0 = 9.3055e-04
Validation auc = 0.652183
Epoch 1397
Validation auc = 0.650275
Epoch 1398
Validation auc = 0.649403
Epoch 1399
Validation auc = 0.648912
Epoch 1400
Loss = 7.3021e-04, PNorm = 124.8577, GNorm = 0.0262, lr_0 = 9.3033e-04
Loss = 2.3205e-05, PNorm = 124.8589, GNorm = 0.0011, lr_0 = 9.3032e-04
Validation auc = 0.648204
Epoch 1401
Validation auc = 0.647331
Epoch 1402
Validation auc = 0.646950
Epoch 1403
Validation auc = 0.646459
Epoch 1404
Validation auc = 0.646241
Epoch 1405
Loss = 3.9788e-04, PNorm = 124.8707, GNorm = 0.0118, lr_0 = 9.3008e-04
Loss = 8.3010e-04, PNorm = 124.8714, GNorm = 0.0343, lr_0 = 9.3007e-04
Validation auc = 0.646078
Epoch 1406
Validation auc = 0.644987
Epoch 1407
Validation auc = 0.641662
Epoch 1408
Validation auc = 0.640244
Epoch 1409
Validation auc = 0.637464
Epoch 1410
Loss = 6.0217e-02, PNorm = 124.8653, GNorm = 1.0504, lr_0 = 9.2985e-04
Validation auc = 0.635719
Epoch 1411
Validation auc = 0.636864
Epoch 1412
Validation auc = 0.638500
Epoch 1413
Validation auc = 0.640462
Epoch 1414
Validation auc = 0.640299
Epoch 1415
Loss = 2.0830e-03, PNorm = 124.9142, GNorm = 0.0620, lr_0 = 9.2961e-04
Validation auc = 0.638718
Epoch 1416
Validation auc = 0.639099
Epoch 1417
Validation auc = 0.638500
Epoch 1418
Validation auc = 0.638445
Epoch 1419
Loss = 4.3162e-02, PNorm = 124.9393, GNorm = 1.7608, lr_0 = 9.2939e-04
Loss = 6.7519e-04, PNorm = 124.9407, GNorm = 0.0246, lr_0 = 9.2938e-04
Validation auc = 0.635065
Epoch 1420
Validation auc = 0.631031
Epoch 1421
Validation auc = 0.632067
Epoch 1422
Validation auc = 0.635556
Epoch 1423
Validation auc = 0.636592
Epoch 1424
Loss = 2.6322e-03, PNorm = 124.9659, GNorm = 0.2205, lr_0 = 9.2914e-04
Validation auc = 0.635828
Epoch 1425
Validation auc = 0.640244
Epoch 1426
Validation auc = 0.642261
Epoch 1427
Validation auc = 0.644769
Epoch 1428
Validation auc = 0.649403
Epoch 1429
Loss = 2.7339e-03, PNorm = 125.0123, GNorm = 0.0871, lr_0 = 9.2891e-04
Validation auc = 0.654146
Epoch 1430
Validation auc = 0.650112
Epoch 1431
Validation auc = 0.645205
Epoch 1432
Validation auc = 0.640408
Epoch 1433
Loss = 1.7574e-02, PNorm = 125.1536, GNorm = 0.1203, lr_0 = 9.2868e-04
Validation auc = 0.644442
Epoch 1434
Validation auc = 0.648313
Epoch 1435
Validation auc = 0.653165
Epoch 1436
Validation auc = 0.653710
Epoch 1437
Validation auc = 0.653219
Epoch 1438
Loss = 1.3123e-02, PNorm = 125.3058, GNorm = 0.3403, lr_0 = 9.2845e-04
Loss = 1.0506e-02, PNorm = 125.3168, GNorm = 0.2704, lr_0 = 9.2844e-04
Validation auc = 0.655563
Epoch 1439
Validation auc = 0.655563
Epoch 1440
Validation auc = 0.654364
Epoch 1441
Validation auc = 0.653710
Epoch 1442
Validation auc = 0.650330
Epoch 1443
Loss = 2.1743e-02, PNorm = 125.4351, GNorm = 1.2607, lr_0 = 9.2822e-04
Validation auc = 0.653165
Epoch 1444
Validation auc = 0.651257
Epoch 1445
Validation auc = 0.648204
Epoch 1446
Validation auc = 0.645369
Epoch 1447
Validation auc = 0.641662
Epoch 1448
Loss = 2.0550e-03, PNorm = 125.5506, GNorm = 0.0660, lr_0 = 9.2798e-04
Validation auc = 0.639917
Epoch 1449
Validation auc = 0.639208
Epoch 1450
Validation auc = 0.640517
Epoch 1451
Validation auc = 0.640408
Epoch 1452
Loss = 1.7531e-03, PNorm = 125.6255, GNorm = 0.0603, lr_0 = 9.2776e-04
Loss = 1.0555e-04, PNorm = 125.6295, GNorm = 0.0035, lr_0 = 9.2775e-04
Validation auc = 0.640571
Epoch 1453
Validation auc = 0.638772
Epoch 1454
Validation auc = 0.636755
Epoch 1455
Validation auc = 0.635610
Epoch 1456
Validation auc = 0.635447
Epoch 1457
Loss = 1.5351e-03, PNorm = 125.6633, GNorm = 0.0093, lr_0 = 9.2752e-04
Loss = 1.0088e-03, PNorm = 125.6652, GNorm = 0.0333, lr_0 = 9.2750e-04
Validation auc = 0.636046
Epoch 1458
Validation auc = 0.636101
Epoch 1459
Validation auc = 0.635610
Epoch 1460
Validation auc = 0.635011
Epoch 1461
Validation auc = 0.631358
Epoch 1462
Loss = 1.5269e-03, PNorm = 125.6908, GNorm = 0.0463, lr_0 = 9.2729e-04
Validation auc = 0.629232
Epoch 1463
Validation auc = 0.626452
Epoch 1464
Validation auc = 0.625852
Epoch 1465
Validation auc = 0.634738
Epoch 1466
Loss = 5.2084e-04, PNorm = 125.7195, GNorm = 0.0193, lr_0 = 9.2706e-04
Validation auc = 0.640408
Epoch 1467
Validation auc = 0.645260
Epoch 1468
Validation auc = 0.646677
Epoch 1469
Validation auc = 0.648912
Epoch 1470
Validation auc = 0.650602
Epoch 1471
Loss = 1.4544e-04, PNorm = 125.7388, GNorm = 0.0050, lr_0 = 9.2683e-04
Loss = 5.8546e-05, PNorm = 125.7397, GNorm = 0.0030, lr_0 = 9.2681e-04
Validation auc = 0.651965
Epoch 1472
Validation auc = 0.652292
Epoch 1473
Validation auc = 0.658017
Epoch 1474
Validation auc = 0.660524
Epoch 1475
Validation auc = 0.654037
Epoch 1476
Loss = 2.7305e-04, PNorm = 125.7691, GNorm = 0.0060, lr_0 = 9.2660e-04
Validation auc = 0.651529
Epoch 1477
Validation auc = 0.660470
Epoch 1478
Validation auc = 0.664014
Epoch 1479
Validation auc = 0.664777
Epoch 1480
Validation auc = 0.648858
Epoch 1481
Loss = 8.2219e-04, PNorm = 125.8104, GNorm = 0.0355, lr_0 = 9.2635e-04
Validation auc = 0.643134
Epoch 1482
Validation auc = 0.636592
Epoch 1483
Validation auc = 0.634138
Epoch 1484
Validation auc = 0.631576
Epoch 1485
Loss = 3.6318e-03, PNorm = 125.8693, GNorm = 0.1150, lr_0 = 9.2614e-04
Loss = 9.5520e-04, PNorm = 125.8731, GNorm = 0.0278, lr_0 = 9.2612e-04
Validation auc = 0.630431
Epoch 1486
Validation auc = 0.629232
Epoch 1487
Validation auc = 0.627760
Epoch 1488
Validation auc = 0.625961
Epoch 1489
Validation auc = 0.623399
Epoch 1490
Loss = 6.8714e-03, PNorm = 125.9310, GNorm = 0.1318, lr_0 = 9.2589e-04
Loss = 8.0220e-03, PNorm = 125.9363, GNorm = 0.3092, lr_0 = 9.2587e-04
Validation auc = 0.622363
Epoch 1491
Validation auc = 0.623726
Epoch 1492
Validation auc = 0.625307
Epoch 1493
Validation auc = 0.627651
Epoch 1494
Validation auc = 0.628032
Epoch 1495
Loss = 1.6535e-03, PNorm = 125.9859, GNorm = 0.0307, lr_0 = 9.2566e-04
Validation auc = 0.629014
Epoch 1496
Validation auc = 0.627760
Epoch 1497
Validation auc = 0.628469
Epoch 1498
Validation auc = 0.628414
Epoch 1499
Loss = 3.0461e-04, PNorm = 126.0180, GNorm = 0.0059, lr_0 = 9.2543e-04
Validation auc = 0.629177
Epoch 1500
Validation auc = 0.628796
Epoch 1501
Validation auc = 0.628142
Epoch 1502
Validation auc = 0.628087
Epoch 1503
Validation auc = 0.628305
Epoch 1504
Loss = 7.6210e-04, PNorm = 126.0317, GNorm = 0.0266, lr_0 = 9.2520e-04
Loss = 1.1724e-03, PNorm = 126.0324, GNorm = 0.0429, lr_0 = 9.2518e-04
Validation auc = 0.628523
Epoch 1505
Validation auc = 0.630813
Epoch 1506
Validation auc = 0.633702
Epoch 1507
Validation auc = 0.635501
Epoch 1508
Validation auc = 0.636155
Epoch 1509
Loss = 4.2067e-04, PNorm = 126.0516, GNorm = 0.0077, lr_0 = 9.2497e-04
Validation auc = 0.635011
Epoch 1510
Validation auc = 0.633430
Epoch 1511
Validation auc = 0.632557
Epoch 1512
Validation auc = 0.632394
Epoch 1513
Validation auc = 0.632503
Epoch 1514
Loss = 2.2340e-04, PNorm = 126.0743, GNorm = 0.0043, lr_0 = 9.2472e-04
Validation auc = 0.632394
Epoch 1515
Validation auc = 0.632285
Epoch 1516
Validation auc = 0.636864
Epoch 1517
Validation auc = 0.640081
Epoch 1518
Loss = 9.0479e-02, PNorm = 126.0911, GNorm = 2.5546, lr_0 = 9.2451e-04
Loss = 6.9510e-04, PNorm = 126.0902, GNorm = 0.0267, lr_0 = 9.2449e-04
Validation auc = 0.635392
Epoch 1519
Validation auc = 0.628905
Epoch 1520
Validation auc = 0.625634
Epoch 1521
Validation auc = 0.626342
Epoch 1522
Validation auc = 0.626724
Epoch 1523
Loss = 1.1880e-03, PNorm = 126.1179, GNorm = 0.0709, lr_0 = 9.2427e-04
Loss = 1.3997e-01, PNorm = 126.1291, GNorm = 4.8912, lr_0 = 9.2425e-04
Validation auc = 0.628523
Epoch 1524
Validation auc = 0.632503
Epoch 1525
Validation auc = 0.644333
Epoch 1526
Validation auc = 0.655618
Epoch 1527
Validation auc = 0.660197
Epoch 1528
Loss = 6.8177e-03, PNorm = 126.3870, GNorm = 0.2115, lr_0 = 9.2404e-04
Validation auc = 0.662978
Epoch 1529
Validation auc = 0.667666
Epoch 1530
Validation auc = 0.668375
Epoch 1531
Validation auc = 0.666249
Epoch 1532
Validation auc = 0.664341
Epoch 1533
Loss = 1.8034e-02, PNorm = 126.5924, GNorm = 0.5572, lr_0 = 9.2379e-04
Validation auc = 0.664504
Epoch 1534
Validation auc = 0.661669
Epoch 1535
Validation auc = 0.661070
Epoch 1536
Validation auc = 0.660470
Epoch 1537
Loss = 5.5492e-04, PNorm = 126.6785, GNorm = 0.0115, lr_0 = 9.2358e-04
Loss = 1.3333e-03, PNorm = 126.6824, GNorm = 0.0381, lr_0 = 9.2356e-04
Validation auc = 0.660797
Epoch 1538
Validation auc = 0.659652
Epoch 1539
Validation auc = 0.657172
Epoch 1540
Validation auc = 0.658017
Epoch 1541
Validation auc = 0.657908
Epoch 1542
Loss = 2.1885e-03, PNorm = 126.7240, GNorm = 0.0754, lr_0 = 9.2335e-04
Validation auc = 0.657444
Epoch 1543
Validation auc = 0.656408
Epoch 1544
Validation auc = 0.656381
Epoch 1545
Validation auc = 0.655863
Epoch 1546
Validation auc = 0.658671
Epoch 1547
Loss = 1.1976e-03, PNorm = 126.7511, GNorm = 0.0719, lr_0 = 9.2310e-04
Validation auc = 0.659816
Epoch 1548
Validation auc = 0.660579
Epoch 1549
Validation auc = 0.660770
Epoch 1550
Validation auc = 0.660306
Epoch 1551
Loss = 8.8207e-04, PNorm = 126.7649, GNorm = 0.0194, lr_0 = 9.2289e-04
Loss = 3.3776e-07, PNorm = 126.7657, GNorm = 0.0000, lr_0 = 9.2287e-04
Validation auc = 0.660252
Epoch 1552
Validation auc = 0.659325
Epoch 1553
Validation auc = 0.659761
Epoch 1554
Validation auc = 0.659843
Epoch 1555
Validation auc = 0.659652
Epoch 1556
Loss = 3.7717e-03, PNorm = 126.7816, GNorm = 0.0271, lr_0 = 9.2264e-04
Loss = 2.3766e-04, PNorm = 126.7829, GNorm = 0.0090, lr_0 = 9.2263e-04
Validation auc = 0.660034
Epoch 1557
Validation auc = 0.660770
Epoch 1558
Validation auc = 0.659189
Epoch 1559
Validation auc = 0.658207
Epoch 1560
Validation auc = 0.655373
Epoch 1561
Loss = 6.1611e-04, PNorm = 126.8017, GNorm = 0.0156, lr_0 = 9.2242e-04
Validation auc = 0.650684
Epoch 1562
Validation auc = 0.651066
Epoch 1563
Validation auc = 0.647822
Epoch 1564
Validation auc = 0.648367
Epoch 1565
Validation auc = 0.649757
Epoch 1566
Loss = 2.4758e-04, PNorm = 126.8424, GNorm = 0.0048, lr_0 = 9.2217e-04
Validation auc = 0.659407
Epoch 1567
Validation auc = 0.664422
Epoch 1568
Validation auc = 0.667285
Epoch 1569
Validation auc = 0.666848
Epoch 1570
Loss = 1.2150e-03, PNorm = 126.9129, GNorm = 0.0231, lr_0 = 9.2196e-04
Loss = 2.3165e-05, PNorm = 126.9165, GNorm = 0.0012, lr_0 = 9.2194e-04
Validation auc = 0.666467
Epoch 1571
Validation auc = 0.664886
Epoch 1572
Validation auc = 0.663059
Epoch 1573
Validation auc = 0.662296
Epoch 1574
Validation auc = 0.660661
Epoch 1575
Loss = 7.0999e-04, PNorm = 126.9546, GNorm = 0.0382, lr_0 = 9.2173e-04
Validation auc = 0.661915
Epoch 1576
Validation auc = 0.663577
Epoch 1577
Validation auc = 0.664613
Epoch 1578
Validation auc = 0.664559
Epoch 1579
Validation auc = 0.665458
Epoch 1580
Loss = 1.5804e-03, PNorm = 127.0039, GNorm = 0.0623, lr_0 = 9.2148e-04
Validation auc = 0.664913
Epoch 1581
Validation auc = 0.663768
Epoch 1582
Validation auc = 0.664341
Epoch 1583
Validation auc = 0.662841
Epoch 1584
Loss = 1.7238e-03, PNorm = 127.0299, GNorm = 0.1717, lr_0 = 9.2127e-04
Loss = 8.7569e-05, PNorm = 127.0313, GNorm = 0.0027, lr_0 = 9.2125e-04
Validation auc = 0.662705
Epoch 1585
Validation auc = 0.663278
Epoch 1586
Validation auc = 0.663332
Epoch 1587
Validation auc = 0.663468
Epoch 1588
Validation auc = 0.663632
Epoch 1589
Loss = 9.1093e-04, PNorm = 127.0443, GNorm = 0.0504, lr_0 = 9.2103e-04
Loss = 1.3550e-05, PNorm = 127.0450, GNorm = 0.0007, lr_0 = 9.2101e-04
Validation auc = 0.663577
Epoch 1590
Validation auc = 0.663959
Epoch 1591
Validation auc = 0.664204
Epoch 1592
Validation auc = 0.664204
Epoch 1593
Validation auc = 0.664204
Epoch 1594
Loss = 6.9246e-05, PNorm = 127.0510, GNorm = 0.0013, lr_0 = 9.2080e-04
Validation auc = 0.664259
Epoch 1595
Validation auc = 0.664368
Epoch 1596
Validation auc = 0.664504
Epoch 1597
Validation auc = 0.664504
Epoch 1598
Validation auc = 0.664286
Epoch 1599
Loss = 1.6673e-04, PNorm = 127.0545, GNorm = 0.0039, lr_0 = 9.2055e-04
Validation auc = 0.664041
Epoch 1600
Validation auc = 0.663686
Epoch 1601
Validation auc = 0.663632
Epoch 1602
Validation auc = 0.663223
Epoch 1603
Loss = 1.5425e-02, PNorm = 127.0579, GNorm = 0.0077, lr_0 = 9.2034e-04
Loss = 5.4033e-04, PNorm = 127.0575, GNorm = 0.0145, lr_0 = 9.2032e-04
Validation auc = 0.662324
Epoch 1604
Validation auc = 0.661179
Epoch 1605
Validation auc = 0.660361
Epoch 1606
Validation auc = 0.659216
Epoch 1607
Validation auc = 0.658126
Epoch 1608
Loss = 1.7421e-04, PNorm = 127.0570, GNorm = 0.0096, lr_0 = 9.2010e-04
Validation auc = 0.657635
Epoch 1609
Validation auc = 0.657226
Epoch 1610
Validation auc = 0.657035
Epoch 1611
Validation auc = 0.657172
Epoch 1612
Validation auc = 0.657390
Epoch 1613
Loss = 1.6978e-04, PNorm = 127.0605, GNorm = 0.0028, lr_0 = 9.1987e-04
Validation auc = 0.657281
Epoch 1614
Validation auc = 0.657499
Epoch 1615
Validation auc = 0.657608
Epoch 1616
Validation auc = 0.657444
Epoch 1617
Loss = 1.2019e-04, PNorm = 127.0630, GNorm = 0.0019, lr_0 = 9.1966e-04
Loss = 3.9339e-06, PNorm = 127.0631, GNorm = 0.0002, lr_0 = 9.1964e-04
Validation auc = 0.657444
Epoch 1618
Validation auc = 0.657635
Epoch 1619
Validation auc = 0.658098
Epoch 1620
Validation auc = 0.658371
Epoch 1621
Validation auc = 0.658862
Epoch 1622
Loss = 6.1023e-04, PNorm = 127.0666, GNorm = 0.0673, lr_0 = 9.1941e-04
Loss = 1.8377e-05, PNorm = 127.0669, GNorm = 0.0014, lr_0 = 9.1939e-04
Validation auc = 0.659679
Epoch 1623
Validation auc = 0.660252
Epoch 1624
Validation auc = 0.660770
Epoch 1625
Validation auc = 0.661342
Epoch 1626
Validation auc = 0.661451
Epoch 1627
Loss = 8.2531e-05, PNorm = 127.0719, GNorm = 0.0028, lr_0 = 9.1918e-04
Validation auc = 0.661397
Epoch 1628
Validation auc = 0.661342
Epoch 1629
Validation auc = 0.661451
Epoch 1630
Validation auc = 0.661478
Epoch 1631
Validation auc = 0.661533
Epoch 1632
Loss = 3.1575e-04, PNorm = 127.0760, GNorm = 0.0134, lr_0 = 9.1894e-04
Validation auc = 0.661260
Epoch 1633
Validation auc = 0.661315
Epoch 1634
Validation auc = 0.661369
Epoch 1635
Validation auc = 0.661206
Epoch 1636
Loss = 8.2054e-05, PNorm = 127.0780, GNorm = 0.0012, lr_0 = 9.1873e-04
Loss = 1.7781e-05, PNorm = 127.0781, GNorm = 0.0011, lr_0 = 9.1871e-04
Validation auc = 0.660961
Epoch 1637
Validation auc = 0.660852
Epoch 1638
Validation auc = 0.660715
Epoch 1639
Validation auc = 0.660552
Epoch 1640
Validation auc = 0.660388
Epoch 1641
Loss = 9.4087e-05, PNorm = 127.0824, GNorm = 0.0023, lr_0 = 9.1848e-04
Validation auc = 0.659979
Epoch 1642
Validation auc = 0.659216
Epoch 1643
Validation auc = 0.657826
Epoch 1644
Validation auc = 0.656899
Epoch 1645
Validation auc = 0.656272
Epoch 1646
Loss = 2.6089e-04, PNorm = 127.0933, GNorm = 0.0114, lr_0 = 9.1825e-04
Validation auc = 0.655727
Epoch 1647
Validation auc = 0.655891
Epoch 1648
Validation auc = 0.655672
Epoch 1649
Validation auc = 0.655509
Epoch 1650
Loss = 1.6572e-04, PNorm = 127.1027, GNorm = 0.0021, lr_0 = 9.1804e-04
Loss = 6.5401e-05, PNorm = 127.1033, GNorm = 0.0027, lr_0 = 9.1803e-04
Validation auc = 0.655727
Epoch 1651
Validation auc = 0.655972
Epoch 1652
Validation auc = 0.664068
Epoch 1653
Validation auc = 0.671864
Epoch 1654
Validation auc = 0.674535
Epoch 1655
Loss = 1.2342e-02, PNorm = 127.1252, GNorm = 0.4822, lr_0 = 9.1780e-04
Loss = 3.0480e-04, PNorm = 127.1277, GNorm = 0.0093, lr_0 = 9.1778e-04
Validation auc = 0.671237
Epoch 1656
Validation auc = 0.664232
Epoch 1657
Validation auc = 0.659516
Epoch 1658
Validation auc = 0.656299
Epoch 1659
Validation auc = 0.654827
Epoch 1660
Loss = 5.3871e-04, PNorm = 127.1578, GNorm = 0.0178, lr_0 = 9.1757e-04
Validation auc = 0.653819
Epoch 1661
Validation auc = 0.652838
Epoch 1662
Validation auc = 0.652592
Epoch 1663
Validation auc = 0.652865
Epoch 1664
Validation auc = 0.653901
Epoch 1665
Loss = 2.5637e-04, PNorm = 127.1728, GNorm = 0.0067, lr_0 = 9.1733e-04
Validation auc = 0.654500
Epoch 1666
Validation auc = 0.655209
Epoch 1667
Validation auc = 0.655972
Epoch 1668
Validation auc = 0.656490
Epoch 1669
Loss = 6.3903e-04, PNorm = 127.1785, GNorm = 0.0011, lr_0 = 9.1712e-04
Loss = 1.7881e-06, PNorm = 127.1789, GNorm = 0.0001, lr_0 = 9.1710e-04
Validation auc = 0.657362
Epoch 1670
Validation auc = 0.658044
Epoch 1671
Validation auc = 0.658071
Epoch 1672
Validation auc = 0.658180
Epoch 1673
Validation auc = 0.658262
Epoch 1674
Loss = 6.5434e-05, PNorm = 127.1822, GNorm = 0.0009, lr_0 = 9.1687e-04
Validation auc = 0.658262
Epoch 1675
Validation auc = 0.658426
Epoch 1676
Validation auc = 0.658453
Epoch 1677
Validation auc = 0.658398
Epoch 1678
Validation auc = 0.658671
Epoch 1679
Loss = 1.4217e-04, PNorm = 127.1855, GNorm = 0.0029, lr_0 = 9.1664e-04
Validation auc = 0.659052
Epoch 1680
Validation auc = 0.659489
Epoch 1681
Validation auc = 0.659925
Epoch 1682
Validation auc = 0.660252
Epoch 1683
Loss = 1.1150e-04, PNorm = 127.1882, GNorm = 0.0049, lr_0 = 9.1642e-04
Validation auc = 0.660470
Epoch 1684
Validation auc = 0.660306
Epoch 1685
Validation auc = 0.660361
Epoch 1686
Validation auc = 0.660306
Epoch 1687
Validation auc = 0.660497
Epoch 1688
Loss = 9.5285e-05, PNorm = 127.1902, GNorm = 0.0030, lr_0 = 9.1619e-04
Loss = 1.4245e-05, PNorm = 127.1903, GNorm = 0.0009, lr_0 = 9.1617e-04
Validation auc = 0.660470
Epoch 1689
Validation auc = 0.660252
Epoch 1690
Validation auc = 0.660552
Epoch 1691
Validation auc = 0.660606
Epoch 1692
Validation auc = 0.660824
Epoch 1693
Loss = 9.7004e-05, PNorm = 127.1919, GNorm = 0.0029, lr_0 = 9.1596e-04
Validation auc = 0.660988
Epoch 1694
Validation auc = 0.660770
Epoch 1695
Validation auc = 0.660852
Epoch 1696
Validation auc = 0.661206
Epoch 1697
Validation auc = 0.661424
Epoch 1698
Loss = 3.7418e-05, PNorm = 127.1946, GNorm = 0.0009, lr_0 = 9.1572e-04
Validation auc = 0.661588
Epoch 1699
Validation auc = 0.661642
Epoch 1700
Validation auc = 0.661369
Epoch 1701
Validation auc = 0.661288
Epoch 1702
Loss = 9.1051e-05, PNorm = 127.1983, GNorm = 0.0022, lr_0 = 9.1551e-04
Loss = 1.0033e-05, PNorm = 127.1985, GNorm = 0.0004, lr_0 = 9.1549e-04
Validation auc = 0.661179
Epoch 1703
Validation auc = 0.661506
Epoch 1704
Validation auc = 0.661942
Epoch 1705
Validation auc = 0.662269
Epoch 1706
Validation auc = 0.662024
Epoch 1707
Loss = 1.0097e-04, PNorm = 127.2013, GNorm = 0.0056, lr_0 = 9.1526e-04
Loss = 1.7205e-05, PNorm = 127.2015, GNorm = 0.0012, lr_0 = 9.1525e-04
Validation auc = 0.661915
Epoch 1708
Validation auc = 0.661751
Epoch 1709
Validation auc = 0.662078
Epoch 1710
Validation auc = 0.662296
Epoch 1711
Validation auc = 0.662351
Epoch 1712
Loss = 6.8661e-05, PNorm = 127.2033, GNorm = 0.0017, lr_0 = 9.1504e-04
Validation auc = 0.662242
Epoch 1713
Validation auc = 0.662351
Epoch 1714
Validation auc = 0.662460
Epoch 1715
Validation auc = 0.662569
Epoch 1716
Loss = 4.6023e-05, PNorm = 127.2047, GNorm = 0.0008, lr_0 = 9.1481e-04
Validation auc = 0.662569
Epoch 1717
Validation auc = 0.662678
Epoch 1718
Validation auc = 0.662460
Epoch 1719
Validation auc = 0.662296
Epoch 1720
Validation auc = 0.662078
Epoch 1721
Loss = 8.7115e-05, PNorm = 127.2067, GNorm = 0.0012, lr_0 = 9.1458e-04
Loss = 3.3217e-05, PNorm = 127.2068, GNorm = 0.0013, lr_0 = 9.1457e-04
Validation auc = 0.662214
Epoch 1722
Validation auc = 0.662487
Epoch 1723
Validation auc = 0.662487
Epoch 1724
Validation auc = 0.662269
Epoch 1725
Validation auc = 0.662433
Epoch 1726
Loss = 3.8908e-05, PNorm = 127.2085, GNorm = 0.0008, lr_0 = 9.1436e-04
Validation auc = 0.662269
Epoch 1727
Validation auc = 0.662160
Epoch 1728
Validation auc = 0.662160
Epoch 1729
Validation auc = 0.662269
Epoch 1730
Validation auc = 0.662378
Epoch 1731
Loss = 1.1662e-04, PNorm = 127.2105, GNorm = 0.0098, lr_0 = 9.1411e-04
Validation auc = 0.662269
Epoch 1732
Validation auc = 0.664886
Epoch 1733
Validation auc = 0.666903
Epoch 1734
Validation auc = 0.668620
Epoch 1735
Loss = 8.8077e-04, PNorm = 127.2274, GNorm = 0.0014, lr_0 = 9.1390e-04
Loss = 1.9037e-04, PNorm = 127.2286, GNorm = 0.0048, lr_0 = 9.1389e-04
Validation auc = 0.669220
Epoch 1736
Validation auc = 0.667584
Epoch 1737
Validation auc = 0.662133
Epoch 1738
Validation auc = 0.658616
Epoch 1739
Validation auc = 0.656272
Epoch 1740
Loss = 1.1508e-04, PNorm = 127.2413, GNorm = 0.0171, lr_0 = 9.1366e-04
Loss = 4.3114e-06, PNorm = 127.2426, GNorm = 0.0003, lr_0 = 9.1364e-04
Validation auc = 0.653901
Epoch 1741
Validation auc = 0.652265
Epoch 1742
Validation auc = 0.651393
Epoch 1743
Validation auc = 0.651148
Epoch 1744
Validation auc = 0.651829
Epoch 1745
Loss = 5.8813e-05, PNorm = 127.2511, GNorm = 0.0050, lr_0 = 9.1343e-04
Validation auc = 0.652374
Epoch 1746
Validation auc = 0.653192
Epoch 1747
Validation auc = 0.654282
Epoch 1748
Validation auc = 0.654718
Epoch 1749
Loss = 1.3676e-04, PNorm = 127.2670, GNorm = 0.0001, lr_0 = 9.1320e-04
Validation auc = 0.655155
Epoch 1750
Validation auc = 0.656027
Epoch 1751
Validation auc = 0.655318
Epoch 1752
Validation auc = 0.654909
Epoch 1753
Validation auc = 0.654855
Epoch 1754
Loss = 9.7451e-05, PNorm = 127.2770, GNorm = 0.0023, lr_0 = 9.1298e-04
Loss = 2.4788e-04, PNorm = 127.2775, GNorm = 0.0139, lr_0 = 9.1296e-04
Validation auc = 0.654718
Epoch 1755
Validation auc = 0.654528
Epoch 1756
Validation auc = 0.654528
Epoch 1757
Validation auc = 0.654310
Epoch 1758
Validation auc = 0.654119
Epoch 1759
Loss = 9.4645e-05, PNorm = 127.2831, GNorm = 0.0037, lr_0 = 9.1275e-04
Validation auc = 0.653955
Epoch 1760
Validation auc = 0.653574
Epoch 1761
Validation auc = 0.653601
Epoch 1762
Validation auc = 0.653764
Epoch 1763
Validation auc = 0.654800
Epoch 1764
Loss = 2.0066e-05, PNorm = 127.2904, GNorm = 0.0006, lr_0 = 9.1251e-04
Validation auc = 0.655672
Epoch 1765
Validation auc = 0.656054
Epoch 1766
Validation auc = 0.656790
Epoch 1767
Validation auc = 0.657390
Epoch 1768
Loss = 3.9383e-05, PNorm = 127.2970, GNorm = 0.0007, lr_0 = 9.1230e-04
Loss = 1.6346e-04, PNorm = 127.2977, GNorm = 0.0049, lr_0 = 9.1228e-04
Validation auc = 0.657499
Epoch 1769
Validation auc = 0.657526
Epoch 1770
Validation auc = 0.657771
Epoch 1771
Validation auc = 0.658153
Epoch 1772
Validation auc = 0.657499
Epoch 1773
Loss = 8.7977e-05, PNorm = 127.3053, GNorm = 0.0019, lr_0 = 9.1206e-04
Loss = 4.8875e-06, PNorm = 127.3057, GNorm = 0.0003, lr_0 = 9.1204e-04
Validation auc = 0.657063
Epoch 1774
Validation auc = 0.657281
Epoch 1775
Validation auc = 0.657226
Epoch 1776
Validation auc = 0.657008
Epoch 1777
Validation auc = 0.655591
Epoch 1778
Loss = 3.2299e-05, PNorm = 127.3168, GNorm = 0.0009, lr_0 = 9.1183e-04
Validation auc = 0.652211
Epoch 1779
Validation auc = 0.659952
Epoch 1780
Validation auc = 0.655972
Epoch 1781
Validation auc = 0.652620
Epoch 1782
Validation auc = 0.650330
Epoch 1783
Loss = 6.8030e-04, PNorm = 127.5091, GNorm = 0.0421, lr_0 = 9.1159e-04
Validation auc = 0.649512
Epoch 1784
Validation auc = 0.648040
Epoch 1785
Validation auc = 0.646514
Epoch 1786
Validation auc = 0.644769
Epoch 1787
Loss = 3.0668e-04, PNorm = 127.6561, GNorm = 0.0154, lr_0 = 9.1138e-04
Loss = 8.6226e-06, PNorm = 127.6623, GNorm = 0.0005, lr_0 = 9.1136e-04
Validation auc = 0.643243
Epoch 1788
Validation auc = 0.647822
Epoch 1789
Validation auc = 0.650820
Epoch 1790
Validation auc = 0.650548
Epoch 1791
Validation auc = 0.649839
Epoch 1792
Loss = 4.4713e-03, PNorm = 127.7449, GNorm = 0.2731, lr_0 = 9.1115e-04
Validation auc = 0.648858
Epoch 1793
Validation auc = 0.647222
Epoch 1794
Validation auc = 0.645641
Epoch 1795
Validation auc = 0.645423
Epoch 1796
Validation auc = 0.644606
Epoch 1797
Loss = 2.6518e-04, PNorm = 127.7855, GNorm = 0.0080, lr_0 = 9.1091e-04
Validation auc = 0.644551
Epoch 1798
Validation auc = 0.644606
Epoch 1799
Validation auc = 0.648967
Epoch 1800
Validation auc = 0.661070
Epoch 1801
Loss = 6.4084e-03, PNorm = 127.8107, GNorm = 0.2779, lr_0 = 9.1070e-04
Loss = 1.0456e-03, PNorm = 127.8144, GNorm = 0.0371, lr_0 = 9.1068e-04
Validation auc = 0.667939
Epoch 1802
Validation auc = 0.668702
Epoch 1803
Validation auc = 0.666303
Epoch 1804
Validation auc = 0.665485
Epoch 1805
Validation auc = 0.662542
Epoch 1806
Loss = 1.7244e-04, PNorm = 127.8816, GNorm = 0.0233, lr_0 = 9.1046e-04
Loss = 7.8280e-06, PNorm = 127.8850, GNorm = 0.0004, lr_0 = 9.1044e-04
Validation auc = 0.660906
Epoch 1807
Validation auc = 0.659925
Epoch 1808
Validation auc = 0.659434
Epoch 1809
Validation auc = 0.659325
Epoch 1810
Validation auc = 0.659107
Epoch 1811
Loss = 7.2933e-05, PNorm = 127.9117, GNorm = 0.0023, lr_0 = 9.1023e-04
Validation auc = 0.658616
Epoch 1812
Validation auc = 0.658507
Epoch 1813
Validation auc = 0.658943
Epoch 1814
Validation auc = 0.658943
Epoch 1815
Validation auc = 0.659052
Epoch 1816
Loss = 6.7547e-04, PNorm = 127.9243, GNorm = 0.0485, lr_0 = 9.0999e-04
Validation auc = 0.660252
Epoch 1817
Validation auc = 0.661179
Epoch 1818
Validation auc = 0.661233
Epoch 1819
Validation auc = 0.661833
Epoch 1820
Loss = 1.5655e-04, PNorm = 127.9349, GNorm = 0.0066, lr_0 = 9.0978e-04
Loss = 8.0863e-06, PNorm = 127.9356, GNorm = 0.0003, lr_0 = 9.0976e-04
Validation auc = 0.662269
Epoch 1821
Validation auc = 0.661887
Epoch 1822
Validation auc = 0.661451
Epoch 1823
Validation auc = 0.661342
Epoch 1824
Validation auc = 0.661179
Epoch 1825
Loss = 7.7345e-05, PNorm = 127.9435, GNorm = 0.0017, lr_0 = 9.0955e-04
Validation auc = 0.660961
Epoch 1826
Validation auc = 0.664123
Epoch 1827
Validation auc = 0.658698
Epoch 1828
Validation auc = 0.618601
Epoch 1829
Validation auc = 0.617892
Epoch 1830
Loss = 2.0979e-02, PNorm = 128.3669, GNorm = 0.5947, lr_0 = 9.0931e-04
Validation auc = 0.617456
Epoch 1831
Validation auc = 0.605299
Epoch 1832
Validation auc = 0.597667
Epoch 1833
Validation auc = 0.596849
Epoch 1834
Loss = 4.4449e-02, PNorm = 128.9000, GNorm = 0.2665, lr_0 = 9.0910e-04
Loss = 5.6182e-05, PNorm = 128.9305, GNorm = 0.0023, lr_0 = 9.0909e-04
Validation auc = 0.598593
Epoch 1835
Validation auc = 0.602955
Epoch 1836
Validation auc = 0.612332
Epoch 1837
Validation auc = 0.623671
Epoch 1838
Validation auc = 0.629613
Epoch 1839
Loss = 1.0048e-02, PNorm = 129.2703, GNorm = 0.1587, lr_0 = 9.0886e-04
Loss = 9.1899e-02, PNorm = 129.2945, GNorm = 4.4345, lr_0 = 9.0884e-04
Validation auc = 0.628905
Epoch 1840
Validation auc = 0.614349
Epoch 1841
Validation auc = 0.610424
Epoch 1842
Validation auc = 0.604645
Epoch 1843
Validation auc = 0.593687
Epoch 1844
Loss = 1.9691e-02, PNorm = 129.7025, GNorm = 0.2573, lr_0 = 9.0863e-04
Validation auc = 0.580985
Epoch 1845
Validation auc = 0.589380
Epoch 1846
Validation auc = 0.604209
Epoch 1847
Validation auc = 0.602192
Epoch 1848
Validation auc = 0.584419
Epoch 1849
Loss = 1.9484e-01, PNorm = 130.6223, GNorm = 1.0484, lr_0 = 9.0839e-04
Validation auc = 0.586436
Epoch 1850
Validation auc = 0.593196
Epoch 1851
Validation auc = 0.594341
Epoch 1852
Validation auc = 0.598266
Epoch 1853
Loss = 7.4248e-02, PNorm = 131.3706, GNorm = 1.2510, lr_0 = 9.0818e-04
Loss = 2.6536e-01, PNorm = 131.4247, GNorm = 7.0564, lr_0 = 9.0817e-04
Validation auc = 0.601210
Epoch 1854
Validation auc = 0.595268
Epoch 1855
Validation auc = 0.603609
Epoch 1856
Validation auc = 0.601428
Epoch 1857
Validation auc = 0.616202
Epoch 1858
Loss = 4.2777e-02, PNorm = 131.9183, GNorm = 1.2607, lr_0 = 9.0794e-04
Validation auc = 0.615712
Epoch 1859
Validation auc = 0.609551
Epoch 1860
Validation auc = 0.600938
Epoch 1861
Validation auc = 0.606553
Epoch 1862
Validation auc = 0.611896
Epoch 1863
Loss = 4.7755e-02, PNorm = 132.2267, GNorm = 1.7631, lr_0 = 9.0772e-04
Validation auc = 0.614458
Epoch 1864
Validation auc = 0.612822
Epoch 1865
Validation auc = 0.613640
Epoch 1866
Validation auc = 0.620836
Epoch 1867
Loss = 7.1874e-03, PNorm = 132.4075, GNorm = 0.0907, lr_0 = 9.0751e-04
Loss = 1.3010e-04, PNorm = 132.4223, GNorm = 0.0047, lr_0 = 9.0749e-04
Validation auc = 0.627651
Epoch 1868
Validation auc = 0.619855
Epoch 1869
Validation auc = 0.592106
Epoch 1870
Validation auc = 0.601483
Epoch 1871
Validation auc = 0.623617
Epoch 1872
Loss = 6.4148e-02, PNorm = 132.7373, GNorm = 0.1358, lr_0 = 9.0727e-04
Loss = 8.5017e-03, PNorm = 132.7735, GNorm = 0.3858, lr_0 = 9.0725e-04
Validation auc = 0.627487
Epoch 1873
Validation auc = 0.624489
Epoch 1874
Validation auc = 0.621927
Epoch 1875
Validation auc = 0.622526
Epoch 1876
Validation auc = 0.612986
Epoch 1877
Loss = 7.1923e-03, PNorm = 133.1640, GNorm = 0.1288, lr_0 = 9.0704e-04
Validation auc = 0.605790
Epoch 1878
Validation auc = 0.603609
Epoch 1879
Validation auc = 0.603882
Epoch 1880
Validation auc = 0.599684
Epoch 1881
Validation auc = 0.595759
Epoch 1882
Loss = 1.2913e-02, PNorm = 133.4343, GNorm = 0.2699, lr_0 = 9.0680e-04
Validation auc = 0.596685
Epoch 1883
Validation auc = 0.602737
Epoch 1884
Validation auc = 0.609061
Epoch 1885
Validation auc = 0.609824
Epoch 1886
Loss = 9.9711e-02, PNorm = 133.5765, GNorm = 1.2923, lr_0 = 9.0659e-04
Loss = 5.3702e-04, PNorm = 133.5919, GNorm = 0.0183, lr_0 = 9.0657e-04
Validation auc = 0.614022
Epoch 1887
Validation auc = 0.615984
Epoch 1888
Validation auc = 0.618928
Epoch 1889
Validation auc = 0.622145
Epoch 1890
Validation auc = 0.622526
Epoch 1891
Loss = 8.2134e-03, PNorm = 133.7543, GNorm = 0.1012, lr_0 = 9.0635e-04
Validation auc = 0.612332
Epoch 1892
Validation auc = 0.596849
Epoch 1893
Validation auc = 0.583002
Epoch 1894
Validation auc = 0.572807
Epoch 1895
Validation auc = 0.574115
Epoch 1896
Loss = 2.8566e-02, PNorm = 133.8798, GNorm = 0.5387, lr_0 = 9.0612e-04
Validation auc = 0.582566
Epoch 1897
Validation auc = 0.588562
Epoch 1898
Validation auc = 0.601428
Epoch 1899
Validation auc = 0.598757
Epoch 1900
Loss = 1.2022e-01, PNorm = 134.4787, GNorm = 1.1338, lr_0 = 9.0592e-04
Loss = 3.1599e-02, PNorm = 134.5507, GNorm = 0.9813, lr_0 = 9.0590e-04
Validation auc = 0.599629
Epoch 1901
Validation auc = 0.618874
Epoch 1902
Validation auc = 0.636864
Epoch 1903
Validation auc = 0.599248
Epoch 1904
Validation auc = 0.587799
Epoch 1905
Loss = 4.6491e-02, PNorm = 135.4069, GNorm = 1.0813, lr_0 = 9.0567e-04
Loss = 3.1387e-02, PNorm = 135.4538, GNorm = 0.7769, lr_0 = 9.0566e-04
Validation auc = 0.580221
Epoch 1906
Validation auc = 0.578259
Epoch 1907
Validation auc = 0.576296
Epoch 1908
Validation auc = 0.580276
Epoch 1909
Validation auc = 0.572698
Epoch 1910
Loss = 1.4320e-01, PNorm = 135.9129, GNorm = 2.2812, lr_0 = 9.0545e-04
Validation auc = 0.557215
Epoch 1911
Validation auc = 0.564139
Epoch 1912
Validation auc = 0.577441
Epoch 1913
Validation auc = 0.569972
Epoch 1914
Validation auc = 0.570299
Epoch 1915
Loss = 4.0190e-02, PNorm = 136.4991, GNorm = 0.5616, lr_0 = 9.0521e-04
Validation auc = 0.546148
Epoch 1916
Validation auc = 0.515892
Epoch 1917
Validation auc = 0.508096
Epoch 1918
Validation auc = 0.543859
Epoch 1919
Loss = 4.2110e-02, PNorm = 136.8420, GNorm = 2.4001, lr_0 = 9.0500e-04
Loss = 1.1638e-02, PNorm = 136.8652, GNorm = 0.4445, lr_0 = 9.0498e-04
Validation auc = 0.590361
Epoch 1920
Validation auc = 0.629941
Epoch 1921
Validation auc = 0.637573
Epoch 1922
Validation auc = 0.638391
Epoch 1923
Validation auc = 0.636701
Epoch 1924
Loss = 7.9542e-03, PNorm = 137.1171, GNorm = 0.1022, lr_0 = 9.0476e-04
Validation auc = 0.636537
Epoch 1925
Validation auc = 0.635338
Epoch 1926
Validation auc = 0.635774
Epoch 1927
Validation auc = 0.635992
Epoch 1928
Validation auc = 0.639045
Epoch 1929
Loss = 3.7776e-03, PNorm = 137.2405, GNorm = 0.0925, lr_0 = 9.0454e-04
Validation auc = 0.639317
Epoch 1930
Validation auc = 0.637409
Epoch 1931
Validation auc = 0.630050
Epoch 1932
Validation auc = 0.623780
Epoch 1933
Loss = 1.2203e-02, PNorm = 137.3320, GNorm = 1.6576, lr_0 = 9.0431e-04
Validation auc = 0.611787
Epoch 1934
Validation auc = 0.586000
Epoch 1935
Validation auc = 0.620782
Epoch 1936
Validation auc = 0.631031
Epoch 1937
Validation auc = 0.632775
Epoch 1938
Loss = 2.6877e-03, PNorm = 137.4632, GNorm = 0.1467, lr_0 = 9.0409e-04
Loss = 1.0683e-01, PNorm = 137.4714, GNorm = 1.6293, lr_0 = 9.0407e-04
Validation auc = 0.633103
Epoch 1939
Validation auc = 0.634902
Epoch 1940
Validation auc = 0.632012
Epoch 1941
Validation auc = 0.628796
Epoch 1942
Validation auc = 0.627596
Epoch 1943
Loss = 5.2069e-02, PNorm = 137.5846, GNorm = 1.3105, lr_0 = 9.0386e-04
Validation auc = 0.623617
Epoch 1944
Validation auc = 0.626561
Epoch 1945
Validation auc = 0.630976
Epoch 1946
Validation auc = 0.637300
Epoch 1947
Validation auc = 0.640517
Epoch 1948
Loss = 1.5942e-02, PNorm = 137.8876, GNorm = 0.3106, lr_0 = 9.0362e-04
Validation auc = 0.644060
Epoch 1949
Validation auc = 0.656490
Epoch 1950
Validation auc = 0.679823
Epoch 1951
Validation auc = 0.689200
Epoch 1952
Loss = 8.9407e-02, PNorm = 138.2586, GNorm = 0.2272, lr_0 = 9.0341e-04
Loss = 1.8753e-02, PNorm = 138.2814, GNorm = 0.5222, lr_0 = 9.0340e-04
Validation auc = 0.689037
Epoch 1953
Validation auc = 0.682004
Epoch 1954
Validation auc = 0.675517
Epoch 1955
Validation auc = 0.672137
Epoch 1956
Validation auc = 0.672954
Epoch 1957
Loss = 1.1122e-02, PNorm = 138.5016, GNorm = 0.1358, lr_0 = 9.0317e-04
Loss = 1.1903e-02, PNorm = 138.5134, GNorm = 0.3251, lr_0 = 9.0316e-04
Validation auc = 0.672736
Epoch 1958
Validation auc = 0.667230
Epoch 1959
Validation auc = 0.661669
Epoch 1960
Validation auc = 0.655073
Epoch 1961
Validation auc = 0.651475
Epoch 1962
Loss = 1.3166e-03, PNorm = 138.6220, GNorm = 0.0244, lr_0 = 9.0295e-04
Validation auc = 0.649130
Epoch 1963
Validation auc = 0.648204
Epoch 1964
Validation auc = 0.648694
Epoch 1965
Validation auc = 0.651638
Epoch 1966
Loss = 1.1819e-03, PNorm = 138.6746, GNorm = 0.0075, lr_0 = 9.0273e-04
Validation auc = 0.653492
Epoch 1967
Validation auc = 0.655836
Epoch 1968
Validation auc = 0.657199
Epoch 1969
Validation auc = 0.657417
Epoch 1970
Validation auc = 0.657472
Epoch 1971
Loss = 8.0627e-02, PNorm = 138.7148, GNorm = 1.9631, lr_0 = 9.0250e-04
Loss = 3.7954e-02, PNorm = 138.7293, GNorm = 5.0238, lr_0 = 9.0249e-04
Validation auc = 0.647822
Epoch 1972
Validation auc = 0.635937
Epoch 1973
Validation auc = 0.632448
Epoch 1974
Validation auc = 0.635665
Epoch 1975
Validation auc = 0.635992
Epoch 1976
Loss = 1.0584e-02, PNorm = 139.0229, GNorm = 0.1786, lr_0 = 9.0228e-04
Validation auc = 0.639154
Epoch 1977
Validation auc = 0.642098
Epoch 1978
Validation auc = 0.643134
Epoch 1979
Validation auc = 0.640735
Epoch 1980
Validation auc = 0.634411
Epoch 1981
Loss = 8.3493e-03, PNorm = 139.2420, GNorm = 0.1550, lr_0 = 9.0204e-04
Validation auc = 0.635120
Epoch 1982
Validation auc = 0.632012
Epoch 1983
Validation auc = 0.627542
Epoch 1984
Validation auc = 0.628305
Epoch 1985
Loss = 6.4564e-02, PNorm = 139.4310, GNorm = 1.7795, lr_0 = 9.0183e-04
Loss = 8.7691e-05, PNorm = 139.4449, GNorm = 0.0030, lr_0 = 9.0181e-04
Validation auc = 0.627378
Epoch 1986
Validation auc = 0.628305
Epoch 1987
Validation auc = 0.637900
Epoch 1988
Validation auc = 0.644442
Epoch 1989
Validation auc = 0.645750
Epoch 1990
Loss = 8.4670e-03, PNorm = 139.6235, GNorm = 0.1730, lr_0 = 9.0159e-04
Loss = 9.5248e-04, PNorm = 139.6354, GNorm = 0.0287, lr_0 = 9.0157e-04
Validation auc = 0.645478
Epoch 1991
Validation auc = 0.645314
Epoch 1992
Validation auc = 0.642479
Epoch 1993
Validation auc = 0.639917
Epoch 1994
Validation auc = 0.639863
Epoch 1995
Loss = 3.9455e-03, PNorm = 139.7559, GNorm = 0.0784, lr_0 = 9.0137e-04
Validation auc = 0.640953
Epoch 1996
Validation auc = 0.641716
Epoch 1997
Validation auc = 0.642425
Epoch 1998
Validation auc = 0.642970
Epoch 1999
Loss = 1.8852e-03, PNorm = 139.8487, GNorm = 0.0311, lr_0 = 9.0114e-04
Validation auc = 0.644442
Model 0 best validation auc = 0.723437 on epoch 672
Loading pretrained parameter "encoder.encoder.0.cached_zero_vector".
Loading pretrained parameter "encoder.encoder.0.W_i.weight".
Loading pretrained parameter "encoder.encoder.0.W_h.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.bias".
Loading pretrained parameter "ffn.1.weight".
Loading pretrained parameter "ffn.1.bias".
Moving model to cuda
Model 0 test auc = 0.679383
Ensemble test auc = 0.679383
Fold 3
Splitting data with seed 3
Class sizes
sars_cov_two_active 0: 98.39%, 1: 1.61%
Total size = 3,294 | train size = 3,294 | val size = 1,096 | test size = 1,086
With class_balance, effective train size = 106
Building model 0
MoleculeModel(
  (sigmoid): Sigmoid()
  (encoder): MPN(
    (encoder): ModuleList(
      (0): MPNEncoder(
        (dropout_layer): Dropout(p=0.05, inplace=False)
        (act_func): ReLU()
        (W_i): Linear(in_features=147, out_features=2100, bias=False)
        (W_h): Linear(in_features=2100, out_features=2100, bias=False)
        (W_o): Linear(in_features=2233, out_features=2100, bias=True)
      )
    )
  )
  (ffn): Sequential(
    (0): Dropout(p=0.05, inplace=False)
    (1): Linear(in_features=2328, out_features=1, bias=True)
  )
)
Number of parameters = 9,412,429
Moving model to cuda
Epoch 0
Validation auc = 0.509132
Epoch 1
Validation auc = 0.603500
Epoch 2
Validation auc = 0.540261
Epoch 3
Validation auc = 0.484981
Epoch 4
Loss = 6.9640e-01, PNorm = 67.4104, GNorm = 1.1566, lr_0 = 2.0385e-04
Loss = 6.7937e-01, PNorm = 67.4124, GNorm = 2.1681, lr_0 = 2.1077e-04
Validation auc = 0.505588
Epoch 5
Validation auc = 0.542060
Epoch 6
Validation auc = 0.589925
Epoch 7
Validation auc = 0.574606
Epoch 8
Validation auc = 0.616911
Epoch 9
Loss = 6.6383e-01, PNorm = 67.4440, GNorm = 1.0412, lr_0 = 3.0077e-04
Validation auc = 0.618165
Epoch 10
Validation auc = 0.626124
Epoch 11
Validation auc = 0.639099
Epoch 12
Validation auc = 0.673608
Epoch 13
Validation auc = 0.671537
Epoch 14
Loss = 6.9580e-01, PNorm = 67.5087, GNorm = 1.0697, lr_0 = 4.0462e-04
Validation auc = 0.678297
Epoch 15
Validation auc = 0.667448
Epoch 16
Validation auc = 0.650330
Epoch 17
Validation auc = 0.645914
Epoch 18
Loss = 6.4187e-01, PNorm = 67.5927, GNorm = 1.0558, lr_0 = 4.9462e-04
Loss = 6.8289e-01, PNorm = 67.6010, GNorm = 3.1220, lr_0 = 5.0154e-04
Validation auc = 0.658235
Epoch 19
Validation auc = 0.658780
Epoch 20
Validation auc = 0.649894
Epoch 21
Validation auc = 0.635447
Epoch 22
Validation auc = 0.643297
Epoch 23
Loss = 6.1829e-01, PNorm = 67.7452, GNorm = 0.7385, lr_0 = 5.9846e-04
Loss = 6.9679e-01, PNorm = 67.7579, GNorm = 4.3437, lr_0 = 6.0538e-04
Validation auc = 0.638609
Epoch 24
Validation auc = 0.637573
Epoch 25
Validation auc = 0.625198
Epoch 26
Validation auc = 0.621436
Epoch 27
Validation auc = 0.603718
Epoch 28
Loss = 5.8935e-01, PNorm = 67.9263, GNorm = 1.9310, lr_0 = 6.9538e-04
Validation auc = 0.646296
Epoch 29
Validation auc = 0.607643
Epoch 30
Validation auc = 0.626506
Epoch 31
Validation auc = 0.592978
Epoch 32
Validation auc = 0.596631
Epoch 33
Loss = 6.5138e-01, PNorm = 68.2403, GNorm = 0.7571, lr_0 = 7.9923e-04
Validation auc = 0.610914
Epoch 34
Validation auc = 0.621381
Epoch 35
Validation auc = 0.625416
Epoch 36
Validation auc = 0.631740
Epoch 37
Loss = 5.6973e-01, PNorm = 68.6287, GNorm = 0.8074, lr_0 = 8.8923e-04
Loss = 6.5414e-01, PNorm = 68.6521, GNorm = 4.1956, lr_0 = 8.9615e-04
Validation auc = 0.634574
Epoch 38
Validation auc = 0.629777
Epoch 39
Validation auc = 0.620019
Epoch 40
Validation auc = 0.612822
Epoch 41
Validation auc = 0.588181
Epoch 42
Loss = 5.8472e-01, PNorm = 69.0236, GNorm = 0.8731, lr_0 = 9.8615e-04
Validation auc = 0.563485
Epoch 43
Validation auc = 0.610315
Epoch 44
Validation auc = 0.622308
Epoch 45
Validation auc = 0.613422
Epoch 46
Validation auc = 0.597994
Epoch 47
Loss = 5.1643e-01, PNorm = 69.5197, GNorm = 0.6938, lr_0 = 9.9977e-04
Validation auc = 0.607916
Epoch 48
Validation auc = 0.618765
Epoch 49
Validation auc = 0.623071
Epoch 50
Validation auc = 0.631194
Epoch 51
Loss = 6.1368e-01, PNorm = 69.9550, GNorm = 0.7864, lr_0 = 9.9954e-04
Loss = 3.7033e-01, PNorm = 69.9894, GNorm = 2.4517, lr_0 = 9.9952e-04
Validation auc = 0.622962
Epoch 52
Validation auc = 0.612386
Epoch 53
Validation auc = 0.641117
Epoch 54
Validation auc = 0.660797
Epoch 55
Validation auc = 0.564139
Epoch 56
Loss = 6.5259e-01, PNorm = 70.4929, GNorm = 1.6600, lr_0 = 9.9927e-04
Loss = 6.0661e-01, PNorm = 70.5348, GNorm = 4.3122, lr_0 = 9.9926e-04
Validation auc = 0.555035
Epoch 57
Validation auc = 0.586763
Epoch 58
Validation auc = 0.597667
Epoch 59
Validation auc = 0.603882
Epoch 60
Validation auc = 0.609769
Epoch 61
Loss = 5.5719e-01, PNorm = 71.0471, GNorm = 0.7559, lr_0 = 9.9903e-04
Validation auc = 0.616311
Epoch 62
Validation auc = 0.598593
Epoch 63
Validation auc = 0.606498
Epoch 64
Validation auc = 0.606280
Epoch 65
Validation auc = 0.638663
Epoch 66
Loss = 5.1471e-01, PNorm = 71.5558, GNorm = 0.9090, lr_0 = 9.9876e-04
Validation auc = 0.652074
Epoch 67
Validation auc = 0.658398
Epoch 68
Validation auc = 0.659652
Epoch 69
Validation auc = 0.641771
Epoch 70
Loss = 4.2806e-01, PNorm = 72.0201, GNorm = 1.0517, lr_0 = 9.9853e-04
Loss = 4.0768e-01, PNorm = 72.0583, GNorm = 3.4247, lr_0 = 9.9851e-04
Validation auc = 0.621600
Epoch 71
Validation auc = 0.592106
Epoch 72
Validation auc = 0.521452
Epoch 73
Validation auc = 0.577986
Epoch 74
Validation auc = 0.615494
Epoch 75
Loss = 4.8967e-01, PNorm = 72.5542, GNorm = 0.8962, lr_0 = 9.9828e-04
Validation auc = 0.624871
Epoch 76
Validation auc = 0.622799
Epoch 77
Validation auc = 0.616039
Epoch 78
Validation auc = 0.609933
Epoch 79
Validation auc = 0.634193
Epoch 80
Loss = 5.1080e-01, PNorm = 73.2040, GNorm = 1.6642, lr_0 = 9.9802e-04
Validation auc = 0.610315
Epoch 81
Validation auc = 0.586109
Epoch 82
Validation auc = 0.583928
Epoch 83
Validation auc = 0.579240
Epoch 84
Loss = 4.4781e-01, PNorm = 73.6680, GNorm = 1.3803, lr_0 = 9.9779e-04
Loss = 1.6696e-01, PNorm = 73.7101, GNorm = 1.3249, lr_0 = 9.9777e-04
Validation auc = 0.556070
Epoch 85
Validation auc = 0.618001
Epoch 86
Validation auc = 0.627651
Epoch 87
Validation auc = 0.615821
Epoch 88
Validation auc = 0.636537
Epoch 89
Loss = 2.7405e-01, PNorm = 74.3026, GNorm = 1.3049, lr_0 = 9.9752e-04
Loss = 6.2311e-01, PNorm = 74.3500, GNorm = 5.8024, lr_0 = 9.9750e-04
Validation auc = 0.662814
Epoch 90
Validation auc = 0.644006
Epoch 91
Validation auc = 0.602791
Epoch 92
Validation auc = 0.617456
Epoch 93
Validation auc = 0.609279
Epoch 94
Loss = 3.2298e-01, PNorm = 75.0010, GNorm = 1.6928, lr_0 = 9.9727e-04
Validation auc = 0.625579
Epoch 95
Validation auc = 0.626015
Epoch 96
Validation auc = 0.607262
Epoch 97
Validation auc = 0.601428
Epoch 98
Validation auc = 0.598866
Epoch 99
Loss = 1.4772e-01, PNorm = 75.6700, GNorm = 0.8701, lr_0 = 9.9701e-04
Validation auc = 0.607371
Epoch 100
Validation auc = 0.620618
Epoch 101
Validation auc = 0.561577
Epoch 102
Validation auc = 0.624871
Epoch 103
Loss = 2.6631e-01, PNorm = 76.1486, GNorm = 1.8866, lr_0 = 9.9678e-04
Loss = 5.2795e-01, PNorm = 76.1866, GNorm = 2.1309, lr_0 = 9.9676e-04
Validation auc = 0.618438
Epoch 104
Validation auc = 0.604318
Epoch 105
Validation auc = 0.620782
Epoch 106
Validation auc = 0.613913
Epoch 107
Validation auc = 0.623889
Epoch 108
Loss = 2.2554e-01, PNorm = 76.7389, GNorm = 1.4020, lr_0 = 9.9651e-04
Validation auc = 0.632448
Epoch 109
Validation auc = 0.597503
Epoch 110
Validation auc = 0.571826
Epoch 111
Validation auc = 0.636864
Epoch 112
Validation auc = 0.635120
Epoch 113
Loss = 2.2660e-01, PNorm = 77.2125, GNorm = 0.9832, lr_0 = 9.9627e-04
Validation auc = 0.628414
Epoch 114
Validation auc = 0.609987
Epoch 115
Validation auc = 0.592051
Epoch 116
Validation auc = 0.588344
Epoch 117
Loss = 1.0471e-01, PNorm = 77.6204, GNorm = 0.4508, lr_0 = 9.9604e-04
Loss = 3.5753e-02, PNorm = 77.6471, GNorm = 0.9400, lr_0 = 9.9602e-04
Validation auc = 0.579840
Epoch 118
Validation auc = 0.581475
Epoch 119
Validation auc = 0.591288
Epoch 120
Validation auc = 0.644824
Epoch 121
Validation auc = 0.639536
Epoch 122
Loss = 1.1007e-01, PNorm = 78.0904, GNorm = 1.7728, lr_0 = 9.9577e-04
Loss = 3.4004e-02, PNorm = 78.1283, GNorm = 0.6489, lr_0 = 9.9575e-04
Validation auc = 0.648803
Epoch 123
Validation auc = 0.632012
Epoch 124
Validation auc = 0.629177
Epoch 125
Validation auc = 0.596740
Epoch 126
Validation auc = 0.506460
Epoch 127
Loss = 1.1766e-01, PNorm = 78.5916, GNorm = 1.7157, lr_0 = 9.9552e-04
Validation auc = 0.642697
Epoch 128
Validation auc = 0.634084
Epoch 129
Validation auc = 0.609333
Epoch 130
Validation auc = 0.607807
Epoch 131
Validation auc = 0.589871
Epoch 132
Loss = 3.2649e-01, PNorm = 79.4066, GNorm = 1.3820, lr_0 = 9.9526e-04
Validation auc = 0.590252
Epoch 133
Validation auc = 0.601210
Epoch 134
Validation auc = 0.589707
Epoch 135
Validation auc = 0.593305
Epoch 136
Loss = 2.0669e-01, PNorm = 80.1111, GNorm = 1.2626, lr_0 = 9.9503e-04
Loss = 4.5469e-02, PNorm = 80.1562, GNorm = 0.6984, lr_0 = 9.9501e-04
Validation auc = 0.607698
Epoch 137
Validation auc = 0.589762
Epoch 138
Validation auc = 0.564248
Epoch 139
Validation auc = 0.579404
Epoch 140
Validation auc = 0.590525
Epoch 141
Loss = 1.7236e-01, PNorm = 80.6746, GNorm = 1.1929, lr_0 = 9.9477e-04
Validation auc = 0.607534
Epoch 142
Validation auc = 0.632067
Epoch 143
Validation auc = 0.640135
Epoch 144
Validation auc = 0.632884
Epoch 145
Validation auc = 0.628959
Epoch 146
Loss = 1.5440e-01, PNorm = 81.1203, GNorm = 0.9473, lr_0 = 9.9452e-04
Validation auc = 0.633212
Epoch 147
Validation auc = 0.642807
Epoch 148
Validation auc = 0.659652
Epoch 149
Validation auc = 0.674590
Epoch 150
Loss = 3.5205e-01, PNorm = 81.4702, GNorm = 2.8300, lr_0 = 9.9429e-04
Loss = 6.7698e-02, PNorm = 81.5013, GNorm = 1.0213, lr_0 = 9.9427e-04
Validation auc = 0.667612
Epoch 151
Validation auc = 0.657690
Epoch 152
Validation auc = 0.646132
Epoch 153
Validation auc = 0.667285
Epoch 154
Validation auc = 0.655781
Epoch 155
Loss = 1.5192e-01, PNorm = 81.9913, GNorm = 1.3787, lr_0 = 9.9403e-04
Loss = 6.0200e-02, PNorm = 82.0231, GNorm = 0.8797, lr_0 = 9.9401e-04
Validation auc = 0.636428
Epoch 156
Validation auc = 0.610260
Epoch 157
Validation auc = 0.635229
Epoch 158
Validation auc = 0.664831
Epoch 159
Validation auc = 0.677425
Epoch 160
Loss = 6.5398e-02, PNorm = 82.3667, GNorm = 0.5355, lr_0 = 9.9378e-04
Validation auc = 0.662869
Epoch 161
Validation auc = 0.646568
Epoch 162
Validation auc = 0.630213
Epoch 163
Validation auc = 0.611732
Epoch 164
Validation auc = 0.607153
Epoch 165
Loss = 2.2207e-01, PNorm = 82.7626, GNorm = 1.5476, lr_0 = 9.9351e-04
Validation auc = 0.617129
Epoch 166
Validation auc = 0.625525
Epoch 167
Validation auc = 0.628360
Epoch 168
Validation auc = 0.642697
Epoch 169
Loss = 4.4290e-02, PNorm = 83.0232, GNorm = 0.3515, lr_0 = 9.9329e-04
Loss = 3.0399e-02, PNorm = 83.0403, GNorm = 0.8957, lr_0 = 9.9327e-04
Validation auc = 0.643897
Epoch 170
Validation auc = 0.649239
Epoch 171
Validation auc = 0.653328
Epoch 172
Validation auc = 0.650003
Epoch 173
Validation auc = 0.640789
Epoch 174
Loss = 4.9910e-02, PNorm = 83.2542, GNorm = 0.1539, lr_0 = 9.9302e-04
Validation auc = 0.628796
Epoch 175
Validation auc = 0.633484
Epoch 176
Validation auc = 0.619146
Epoch 177
Validation auc = 0.597503
Epoch 178
Validation auc = 0.590252
Epoch 179
Loss = 2.8224e-01, PNorm = 83.5901, GNorm = 4.0012, lr_0 = 9.9277e-04
Validation auc = 0.574388
Epoch 180
Validation auc = 0.587363
Epoch 181
Validation auc = 0.589162
Epoch 182
Validation auc = 0.582566
Epoch 183
Loss = 4.2336e-02, PNorm = 84.1135, GNorm = 0.2326, lr_0 = 9.9253e-04
Validation auc = 0.584692
Epoch 184
Validation auc = 0.602192
Epoch 185
Validation auc = 0.610424
Epoch 186
Validation auc = 0.604754
Epoch 187
Validation auc = 0.590252
Epoch 188
Loss = 5.0096e-02, PNorm = 84.4478, GNorm = 0.1756, lr_0 = 9.9228e-04
Loss = 1.3902e-02, PNorm = 84.4664, GNorm = 0.3240, lr_0 = 9.9226e-04
Validation auc = 0.582293
Epoch 189
Validation auc = 0.594886
Epoch 190
Validation auc = 0.608352
Epoch 191
Validation auc = 0.614839
Epoch 192
Validation auc = 0.617456
Epoch 193
Loss = 1.6278e-01, PNorm = 84.6394, GNorm = 2.1178, lr_0 = 9.9204e-04
Validation auc = 0.614730
Epoch 194
Validation auc = 0.613913
Epoch 195
Validation auc = 0.614240
Epoch 196
Validation auc = 0.618710
Epoch 197
Validation auc = 0.623017
Epoch 198
Loss = 3.8897e-02, PNorm = 84.8087, GNorm = 0.4923, lr_0 = 9.9177e-04
Validation auc = 0.626288
Epoch 199
Validation auc = 0.638173
Epoch 200
Validation auc = 0.646677
Epoch 201
Validation auc = 0.646023
Epoch 202
Loss = 4.6766e-03, PNorm = 84.9502, GNorm = 0.1002, lr_0 = 9.9154e-04
Loss = 4.8517e-04, PNorm = 84.9610, GNorm = 0.0123, lr_0 = 9.9153e-04
Validation auc = 0.646568
Epoch 203
Validation auc = 0.648258
Epoch 204
Validation auc = 0.648476
Epoch 205
Validation auc = 0.646514
Epoch 206
Validation auc = 0.647331
Epoch 207
Loss = 3.5700e-02, PNorm = 85.1281, GNorm = 0.2095, lr_0 = 9.9128e-04
Loss = 9.5913e-03, PNorm = 85.1388, GNorm = 0.2956, lr_0 = 9.9126e-04
Validation auc = 0.648531
Epoch 208
Validation auc = 0.654310
Epoch 209
Validation auc = 0.662869
Epoch 210
Validation auc = 0.669574
Epoch 211
Validation auc = 0.665595
Epoch 212
Loss = 1.7380e-02, PNorm = 85.2588, GNorm = 0.5292, lr_0 = 9.9103e-04
Validation auc = 0.661070
Epoch 213
Validation auc = 0.663904
Epoch 214
Validation auc = 0.661070
Epoch 215
Validation auc = 0.655563
Epoch 216
Loss = 3.8393e-03, PNorm = 85.3642, GNorm = 0.1674, lr_0 = 9.9079e-04
Validation auc = 0.651911
Epoch 217
Validation auc = 0.644660
Epoch 218
Validation auc = 0.643679
Epoch 219
Validation auc = 0.648967
Epoch 220
Validation auc = 0.656490
Epoch 221
Loss = 7.6943e-03, PNorm = 85.4316, GNorm = 0.0928, lr_0 = 9.9054e-04
Loss = 4.4754e-04, PNorm = 85.4358, GNorm = 0.0140, lr_0 = 9.9052e-04
Validation auc = 0.663850
Epoch 222
Validation auc = 0.667993
Epoch 223
Validation auc = 0.670392
Epoch 224
Validation auc = 0.673445
Epoch 225
Validation auc = 0.672082
Epoch 226
Loss = 3.0538e-03, PNorm = 85.4795, GNorm = 0.0680, lr_0 = 9.9030e-04
Validation auc = 0.673118
Epoch 227
Validation auc = 0.675680
Epoch 228
Validation auc = 0.676988
Epoch 229
Validation auc = 0.677425
Epoch 230
Validation auc = 0.678242
Epoch 231
Loss = 8.1459e-04, PNorm = 85.5106, GNorm = 0.0187, lr_0 = 9.9003e-04
Validation auc = 0.677479
Epoch 232
Validation auc = 0.678624
Epoch 233
Validation auc = 0.678024
Epoch 234
Validation auc = 0.677806
Epoch 235
Loss = 2.9405e-03, PNorm = 85.5348, GNorm = 0.0816, lr_0 = 9.8980e-04
Loss = 8.7100e-04, PNorm = 85.5367, GNorm = 0.0395, lr_0 = 9.8979e-04
Validation auc = 0.677915
Epoch 236
Validation auc = 0.678297
Epoch 237
Validation auc = 0.679387
Epoch 238
Validation auc = 0.653437
Epoch 239
Validation auc = 0.630595
Epoch 240
Loss = 6.6164e-02, PNorm = 85.5690, GNorm = 1.3635, lr_0 = 9.8954e-04
Loss = 3.1395e-02, PNorm = 85.5737, GNorm = 1.7477, lr_0 = 9.8952e-04
Validation auc = 0.663250
Epoch 241
Validation auc = 0.687728
Epoch 242
Validation auc = 0.692308
Epoch 243
Validation auc = 0.693071
Epoch 244
Validation auc = 0.686692
Epoch 245
Loss = 5.4005e-02, PNorm = 85.8151, GNorm = 1.2544, lr_0 = 9.8930e-04
Validation auc = 0.681241
Epoch 246
Validation auc = 0.676116
Epoch 247
Validation auc = 0.670446
Epoch 248
Validation auc = 0.667721
Epoch 249
Loss = 5.0641e-02, PNorm = 86.2364, GNorm = 0.9007, lr_0 = 9.8905e-04
Validation auc = 0.671046
Epoch 250
Validation auc = 0.671646
Epoch 251
Validation auc = 0.672191
Epoch 252
Validation auc = 0.667339
Epoch 253
Validation auc = 0.664450
Epoch 254
Loss = 3.0423e-02, PNorm = 86.5167, GNorm = 0.5897, lr_0 = 9.8880e-04
Loss = 1.3007e-02, PNorm = 86.5316, GNorm = 0.3273, lr_0 = 9.8879e-04
Validation auc = 0.664722
Epoch 255
Validation auc = 0.669084
Epoch 256
Validation auc = 0.652947
Epoch 257
Validation auc = 0.650057
Epoch 258
Validation auc = 0.651420
Epoch 259
Loss = 7.6134e-02, PNorm = 86.7696, GNorm = 0.7903, lr_0 = 9.8856e-04
Validation auc = 0.655454
Epoch 260
Validation auc = 0.662923
Epoch 261
Validation auc = 0.663904
Epoch 262
Validation auc = 0.672300
Epoch 263
Validation auc = 0.679660
Epoch 264
Loss = 1.5042e-02, PNorm = 87.0959, GNorm = 0.3353, lr_0 = 9.8830e-04
Validation auc = 0.686038
Epoch 265
Validation auc = 0.687510
Epoch 266
Validation auc = 0.685493
Epoch 267
Validation auc = 0.678897
Epoch 268
Loss = 7.0061e-02, PNorm = 87.3492, GNorm = 1.3316, lr_0 = 9.8807e-04
Loss = 1.7836e-03, PNorm = 87.3788, GNorm = 0.0783, lr_0 = 9.8805e-04
Validation auc = 0.665595
Epoch 269
Validation auc = 0.658616
Epoch 270
Validation auc = 0.665540
Epoch 271
Validation auc = 0.667775
Epoch 272
Validation auc = 0.669465
Epoch 273
Loss = 1.0703e-01, PNorm = 87.6981, GNorm = 1.5557, lr_0 = 9.8781e-04
Loss = 4.1516e-03, PNorm = 87.7138, GNorm = 0.1523, lr_0 = 9.8779e-04
Validation auc = 0.666794
Epoch 274
Validation auc = 0.663359
Epoch 275
Validation auc = 0.662487
Epoch 276
Validation auc = 0.661342
Epoch 277
Validation auc = 0.663359
Epoch 278
Loss = 1.1891e-02, PNorm = 87.8836, GNorm = 0.2080, lr_0 = 9.8756e-04
Validation auc = 0.670228
Epoch 279
Validation auc = 0.672300
Epoch 280
Validation auc = 0.668266
Epoch 281
Validation auc = 0.681295
Epoch 282
Validation auc = 0.684566
Epoch 283
Loss = 3.2907e-02, PNorm = 88.2629, GNorm = 0.7150, lr_0 = 9.8730e-04
Validation auc = 0.664123
Epoch 284
Validation auc = 0.656381
Epoch 285
Validation auc = 0.654146
Epoch 286
Validation auc = 0.652783
Epoch 287
Loss = 2.4119e-02, PNorm = 88.6971, GNorm = 0.2860, lr_0 = 9.8707e-04
Loss = 1.4855e-02, PNorm = 88.7231, GNorm = 0.5298, lr_0 = 9.8705e-04
Validation auc = 0.659162
Epoch 288
Validation auc = 0.669302
Epoch 289
Validation auc = 0.669629
Epoch 290
Validation auc = 0.673717
Epoch 291
Validation auc = 0.672682
Epoch 292
Loss = 3.6806e-02, PNorm = 88.9489, GNorm = 1.1224, lr_0 = 9.8683e-04
Validation auc = 0.664286
Epoch 293
Validation auc = 0.657799
Epoch 294
Validation auc = 0.653819
Epoch 295
Validation auc = 0.652565
Epoch 296
Validation auc = 0.650548
Epoch 297
Loss = 2.3190e-01, PNorm = 89.1074, GNorm = 2.2300, lr_0 = 9.8656e-04
Validation auc = 0.638445
Epoch 298
Validation auc = 0.650820
Epoch 299
Validation auc = 0.655236
Epoch 300
Validation auc = 0.653982
Epoch 301
Loss = 1.4093e-01, PNorm = 89.2809, GNorm = 1.7779, lr_0 = 9.8634e-04
Loss = 9.4237e-01, PNorm = 89.2985, GNorm = 7.3384, lr_0 = 9.8632e-04
Validation auc = 0.625634
Epoch 302
Validation auc = 0.593632
Epoch 303
Validation auc = 0.637900
Epoch 304
Validation auc = 0.647004
Epoch 305
Validation auc = 0.644060
Epoch 306
Loss = 2.4888e-01, PNorm = 89.8353, GNorm = 2.1223, lr_0 = 9.8607e-04
Loss = 2.8413e-02, PNorm = 89.8890, GNorm = 0.7240, lr_0 = 9.8606e-04
Validation auc = 0.665922
Epoch 307
Validation auc = 0.665158
Epoch 308
Validation auc = 0.682331
Epoch 309
Validation auc = 0.701521
Epoch 310
Validation auc = 0.728234
Epoch 311
Loss = 3.8971e-02, PNorm = 90.4925, GNorm = 0.3893, lr_0 = 9.8583e-04
Validation auc = 0.742899
Epoch 312
Validation auc = 0.732541
Epoch 313
Validation auc = 0.715096
Epoch 314
Validation auc = 0.696287
Epoch 315
Validation auc = 0.686365
Epoch 316
Loss = 8.8399e-02, PNorm = 90.9769, GNorm = 1.2106, lr_0 = 9.8557e-04
Validation auc = 0.687783
Epoch 317
Validation auc = 0.679878
Epoch 318
Validation auc = 0.679769
Epoch 319
Validation auc = 0.682985
Epoch 320
Loss = 4.1589e-02, PNorm = 91.2697, GNorm = 0.1645, lr_0 = 9.8534e-04
Loss = 3.3808e-01, PNorm = 91.2869, GNorm = 3.5448, lr_0 = 9.8532e-04
Validation auc = 0.684239
Epoch 321
Validation auc = 0.677370
Epoch 322
Validation auc = 0.670119
Epoch 323
Validation auc = 0.665376
Epoch 324
Validation auc = 0.662433
Epoch 325
Loss = 6.8577e-02, PNorm = 91.4934, GNorm = 1.6543, lr_0 = 9.8509e-04
Validation auc = 0.669956
Epoch 326
Validation auc = 0.673936
Epoch 327
Validation auc = 0.673009
Epoch 328
Validation auc = 0.671373
Epoch 329
Validation auc = 0.672409
Epoch 330
Loss = 9.2511e-03, PNorm = 91.6321, GNorm = 0.1458, lr_0 = 9.8483e-04
Validation auc = 0.672736
Epoch 331
Validation auc = 0.674317
Epoch 332
Validation auc = 0.674099
Epoch 333
Validation auc = 0.674317
Epoch 334
Loss = 3.6606e-02, PNorm = 91.7021, GNorm = 0.1329, lr_0 = 9.8461e-04
Loss = 5.4137e-03, PNorm = 91.7059, GNorm = 0.1267, lr_0 = 9.8459e-04
Validation auc = 0.675571
Epoch 335
Validation auc = 0.676498
Epoch 336
Validation auc = 0.678515
Epoch 337
Validation auc = 0.679932
Epoch 338
Validation auc = 0.681077
Epoch 339
Loss = 4.6714e-03, PNorm = 91.7590, GNorm = 0.1105, lr_0 = 9.8434e-04
Loss = 1.9402e-04, PNorm = 91.7619, GNorm = 0.0083, lr_0 = 9.8433e-04
Validation auc = 0.682931
Epoch 340
Validation auc = 0.683040
Epoch 341
Validation auc = 0.684076
Epoch 342
Validation auc = 0.684185
Epoch 343
Validation auc = 0.681950
Epoch 344
Loss = 3.3880e-02, PNorm = 91.7963, GNorm = 1.0030, lr_0 = 9.8410e-04
Validation auc = 0.683694
Epoch 345
Validation auc = 0.680205
Epoch 346
Validation auc = 0.686093
Epoch 347
Validation auc = 0.685548
Epoch 348
Validation auc = 0.682604
Epoch 349
Loss = 3.7185e-02, PNorm = 91.8657, GNorm = 0.7035, lr_0 = 9.8384e-04
Validation auc = 0.682440
Epoch 350
Validation auc = 0.676225
Epoch 351
Validation auc = 0.671155
Epoch 352
Validation auc = 0.674099
Epoch 353
Loss = 2.0374e-02, PNorm = 91.9618, GNorm = 0.2354, lr_0 = 9.8361e-04
Loss = 5.5776e-03, PNorm = 91.9739, GNorm = 0.1873, lr_0 = 9.8359e-04
Validation auc = 0.681731
Epoch 354
Validation auc = 0.686747
Epoch 355
Validation auc = 0.690999
Epoch 356
Validation auc = 0.688928
Epoch 357
Validation auc = 0.672900
Epoch 358
Loss = 1.7970e-02, PNorm = 92.1348, GNorm = 0.9036, lr_0 = 9.8335e-04
Validation auc = 0.654201
Epoch 359
Validation auc = 0.644006
Epoch 360
Validation auc = 0.641444
Epoch 361
Validation auc = 0.643188
Epoch 362
Validation auc = 0.641280
Epoch 363
Loss = 9.5461e-03, PNorm = 92.2786, GNorm = 0.1637, lr_0 = 9.8311e-04
Validation auc = 0.638609
Epoch 364
Validation auc = 0.635011
Epoch 365
Validation auc = 0.628687
Epoch 366
Validation auc = 0.622363
Epoch 367
Loss = 1.2529e-02, PNorm = 92.3732, GNorm = 0.2540, lr_0 = 9.8288e-04
Loss = 6.1028e-03, PNorm = 92.3784, GNorm = 0.1662, lr_0 = 9.8286e-04
Validation auc = 0.611950
Epoch 368
Validation auc = 0.624162
Epoch 369
Validation auc = 0.637409
Epoch 370
Validation auc = 0.641062
Epoch 371
Validation auc = 0.637955
Epoch 372
Loss = 1.2139e-02, PNorm = 92.4636, GNorm = 0.4147, lr_0 = 9.8262e-04
Loss = 3.9712e-02, PNorm = 92.4714, GNorm = 1.2826, lr_0 = 9.8260e-04
Validation auc = 0.643134
Epoch 373
Validation auc = 0.654528
Epoch 374
Validation auc = 0.658235
Epoch 375
Validation auc = 0.661070
Epoch 376
Validation auc = 0.662760
Epoch 377
Loss = 9.0136e-02, PNorm = 92.5836, GNorm = 1.4024, lr_0 = 9.8237e-04
Validation auc = 0.674808
Epoch 378
Validation auc = 0.680205
Epoch 379
Validation auc = 0.674862
Epoch 380
Validation auc = 0.672082
Epoch 381
Validation auc = 0.661942
Epoch 382
Loss = 5.8539e-02, PNorm = 93.0753, GNorm = 0.7861, lr_0 = 9.8211e-04
Validation auc = 0.659543
Epoch 383
Validation auc = 0.654855
Epoch 384
Validation auc = 0.652020
Epoch 385
Validation auc = 0.646786
Epoch 386
Loss = 2.7612e-02, PNorm = 93.4477, GNorm = 0.0365, lr_0 = 9.8189e-04
Loss = 2.9624e-03, PNorm = 93.4650, GNorm = 0.0582, lr_0 = 9.8187e-04
Validation auc = 0.646568
Epoch 387
Validation auc = 0.644933
Epoch 388
Validation auc = 0.646405
Epoch 389
Validation auc = 0.644115
Epoch 390
Validation auc = 0.637464
Epoch 391
Loss = 9.5138e-03, PNorm = 93.6310, GNorm = 0.1552, lr_0 = 9.8163e-04
Validation auc = 0.638173
Epoch 392
Validation auc = 0.639917
Epoch 393
Validation auc = 0.640571
Epoch 394
Validation auc = 0.645532
Epoch 395
Validation auc = 0.650930
Epoch 396
Loss = 7.4762e-02, PNorm = 93.7535, GNorm = 1.9194, lr_0 = 9.8138e-04
Validation auc = 0.655454
Epoch 397
Validation auc = 0.652347
Epoch 398
Validation auc = 0.654528
Epoch 399
Validation auc = 0.656708
Epoch 400
Loss = 9.2834e-03, PNorm = 93.8809, GNorm = 0.5496, lr_0 = 9.8116e-04
Loss = 5.9724e-04, PNorm = 93.8878, GNorm = 0.0227, lr_0 = 9.8114e-04
Validation auc = 0.658017
Epoch 401
Validation auc = 0.661288
Epoch 402
Validation auc = 0.662869
Epoch 403
Validation auc = 0.664123
Epoch 404
Validation auc = 0.660470
Epoch 405
Loss = 9.1562e-03, PNorm = 93.9776, GNorm = 0.1728, lr_0 = 9.8089e-04
Loss = 4.7756e-03, PNorm = 93.9860, GNorm = 0.1228, lr_0 = 9.8088e-04
Validation auc = 0.658453
Epoch 406
Validation auc = 0.658071
Epoch 407
Validation auc = 0.657962
Epoch 408
Validation auc = 0.657417
Epoch 409
Validation auc = 0.658126
Epoch 410
Loss = 5.1382e-03, PNorm = 94.0685, GNorm = 0.2191, lr_0 = 9.8065e-04
Validation auc = 0.658507
Epoch 411
Validation auc = 0.659380
Epoch 412
Validation auc = 0.660524
Epoch 413
Validation auc = 0.664341
Epoch 414
Validation auc = 0.662542
Epoch 415
Loss = 4.2043e-03, PNorm = 94.1125, GNorm = 0.0723, lr_0 = 9.8039e-04
Validation auc = 0.662869
Epoch 416
Validation auc = 0.670119
Epoch 417
Validation auc = 0.668320
Epoch 418
Validation auc = 0.666412
Epoch 419
Loss = 4.6812e-02, PNorm = 94.1719, GNorm = 0.0650, lr_0 = 9.8016e-04
Loss = 1.2025e-03, PNorm = 94.1754, GNorm = 0.0330, lr_0 = 9.8015e-04
Validation auc = 0.666085
Epoch 420
Validation auc = 0.659979
Epoch 421
Validation auc = 0.654528
Epoch 422
Validation auc = 0.652129
Epoch 423
Validation auc = 0.652838
Epoch 424
Loss = 2.0298e-02, PNorm = 94.2665, GNorm = 0.4787, lr_0 = 9.7990e-04
Validation auc = 0.653601
Epoch 425
Validation auc = 0.655618
Epoch 426
Validation auc = 0.660197
Epoch 427
Validation auc = 0.662651
Epoch 428
Validation auc = 0.665267
Epoch 429
Loss = 3.3225e-03, PNorm = 94.3278, GNorm = 0.0571, lr_0 = 9.7966e-04
Validation auc = 0.667666
Epoch 430
Validation auc = 0.669520
Epoch 431
Validation auc = 0.670746
Epoch 432
Validation auc = 0.671755
Epoch 433
Loss = 3.9823e-02, PNorm = 94.3623, GNorm = 0.0142, lr_0 = 9.7942e-04
Validation auc = 0.671864
Epoch 434
Validation auc = 0.672082
Epoch 435
Validation auc = 0.671864
Epoch 436
Validation auc = 0.672791
Epoch 437
Validation auc = 0.663904
Epoch 438
Loss = 1.4567e-02, PNorm = 94.3858, GNorm = 0.0539, lr_0 = 9.7917e-04
Loss = 8.4042e-04, PNorm = 94.3879, GNorm = 0.0367, lr_0 = 9.7916e-04
Validation auc = 0.658235
Epoch 439
Validation auc = 0.655563
Epoch 440
Validation auc = 0.655018
Epoch 441
Validation auc = 0.658507
Epoch 442
Validation auc = 0.659162
Epoch 443
Loss = 1.9695e-03, PNorm = 94.4147, GNorm = 0.0539, lr_0 = 9.7893e-04
Validation auc = 0.658562
Epoch 444
Validation auc = 0.657362
Epoch 445
Validation auc = 0.658562
Epoch 446
Validation auc = 0.660797
Epoch 447
Validation auc = 0.663305
Epoch 448
Loss = 5.1618e-03, PNorm = 94.4399, GNorm = 0.1041, lr_0 = 9.7867e-04
Validation auc = 0.662596
Epoch 449
Validation auc = 0.661669
Epoch 450
Validation auc = 0.661887
Epoch 451
Validation auc = 0.662923
Epoch 452
Loss = 1.7892e-03, PNorm = 94.4787, GNorm = 0.0802, lr_0 = 9.7845e-04
Loss = 7.5543e-05, PNorm = 94.4809, GNorm = 0.0033, lr_0 = 9.7843e-04
Validation auc = 0.666140
Epoch 453
Validation auc = 0.669084
Epoch 454
Validation auc = 0.672191
Epoch 455
Validation auc = 0.674372
Epoch 456
Validation auc = 0.676498
Epoch 457
Loss = 1.8114e-03, PNorm = 94.5047, GNorm = 0.0060, lr_0 = 9.7819e-04
Loss = 5.4197e-04, PNorm = 94.5061, GNorm = 0.0333, lr_0 = 9.7817e-04
Validation auc = 0.677752
Epoch 458
Validation auc = 0.680314
Epoch 459
Validation auc = 0.682876
Epoch 460
Validation auc = 0.684893
Epoch 461
Validation auc = 0.658289
Epoch 462
Loss = 1.1163e-02, PNorm = 94.5327, GNorm = 0.3637, lr_0 = 9.7794e-04
Validation auc = 0.624652
Epoch 463
Validation auc = 0.670610
Epoch 464
Validation auc = 0.686802
Epoch 465
Validation auc = 0.692744
Epoch 466
Loss = 8.3989e-04, PNorm = 94.5934, GNorm = 0.0259, lr_0 = 9.7770e-04
Validation auc = 0.695688
Epoch 467
Validation auc = 0.697977
Epoch 468
Validation auc = 0.700267
Epoch 469
Validation auc = 0.700322
Epoch 470
Validation auc = 0.700594
Epoch 471
Loss = 7.0871e-02, PNorm = 94.6267, GNorm = 0.1866, lr_0 = 9.7746e-04
Loss = 7.2411e-04, PNorm = 94.6281, GNorm = 0.0277, lr_0 = 9.7744e-04
Validation auc = 0.698305
Epoch 472
Validation auc = 0.697868
Epoch 473
Validation auc = 0.697596
Epoch 474
Validation auc = 0.697378
Epoch 475
Validation auc = 0.696724
Epoch 476
Loss = 3.7229e-03, PNorm = 94.6637, GNorm = 0.1363, lr_0 = 9.7721e-04
Validation auc = 0.696015
Epoch 477
Validation auc = 0.695088
Epoch 478
Validation auc = 0.693453
Epoch 479
Validation auc = 0.693780
Epoch 480
Validation auc = 0.694052
Epoch 481
Loss = 3.3823e-04, PNorm = 94.7020, GNorm = 0.0079, lr_0 = 9.7695e-04
Validation auc = 0.694325
Epoch 482
Validation auc = 0.694761
Epoch 483
Validation auc = 0.694543
Epoch 484
Validation auc = 0.694815
Epoch 485
Loss = 3.2444e-02, PNorm = 94.7145, GNorm = 0.9734, lr_0 = 9.7673e-04
Loss = 2.3448e-04, PNorm = 94.7153, GNorm = 0.0080, lr_0 = 9.7671e-04
Validation auc = 0.689255
Epoch 486
Validation auc = 0.678624
Epoch 487
Validation auc = 0.665867
Epoch 488
Validation auc = 0.655400
Epoch 489
Validation auc = 0.647659
Epoch 490
Loss = 5.3545e-02, PNorm = 94.7233, GNorm = 0.0729, lr_0 = 9.7647e-04
Loss = 1.3493e-03, PNorm = 94.7228, GNorm = 0.0674, lr_0 = 9.7645e-04
Validation auc = 0.637791
Epoch 491
Validation auc = 0.634302
Epoch 492
Validation auc = 0.639045
Epoch 493
Validation auc = 0.647440
Epoch 494
Validation auc = 0.654255
Epoch 495
Loss = 1.3575e-03, PNorm = 94.7396, GNorm = 0.0234, lr_0 = 9.7623e-04
Validation auc = 0.657472
Epoch 496
Validation auc = 0.658289
Epoch 497
Validation auc = 0.658998
Epoch 498
Validation auc = 0.659380
Epoch 499
Loss = 5.9734e-02, PNorm = 94.7595, GNorm = 9.1844, lr_0 = 9.7599e-04
Validation auc = 0.662324
Epoch 500
Validation auc = 0.661669
Epoch 501
Validation auc = 0.647059
Epoch 502
Validation auc = 0.679169
Epoch 503
Validation auc = 0.622145
Epoch 504
Loss = 5.5500e-01, PNorm = 95.4696, GNorm = 6.0502, lr_0 = 9.7574e-04
Loss = 1.8787e+00, PNorm = 95.5437, GNorm = 28.4097, lr_0 = 9.7573e-04
Validation auc = 0.662651
Epoch 505
Validation auc = 0.719621
Epoch 506
Validation auc = 0.730742
Epoch 507
Validation auc = 0.746770
Epoch 508
Validation auc = 0.723055
Epoch 509
Loss = 3.0519e-01, PNorm = 96.8580, GNorm = 2.3203, lr_0 = 9.7550e-04
Validation auc = 0.703266
Epoch 510
Validation auc = 0.687892
Epoch 511
Validation auc = 0.684348
Epoch 512
Validation auc = 0.698523
Epoch 513
Validation auc = 0.707627
Epoch 514
Loss = 1.1159e-01, PNorm = 97.8798, GNorm = 1.1863, lr_0 = 9.7524e-04
Validation auc = 0.717712
Epoch 515
Validation auc = 0.713569
Epoch 516
Validation auc = 0.699340
Epoch 517
Validation auc = 0.685657
Epoch 518
Loss = 1.3610e-02, PNorm = 98.3703, GNorm = 0.2631, lr_0 = 9.7502e-04
Loss = 8.9017e-03, PNorm = 98.4041, GNorm = 0.1997, lr_0 = 9.7500e-04
Validation auc = 0.664286
Epoch 519
Validation auc = 0.681840
Epoch 520
Validation auc = 0.649185
Epoch 521
Validation auc = 0.627051
Epoch 522
Validation auc = 0.663359
Epoch 523
Loss = 6.2287e-02, PNorm = 98.8793, GNorm = 1.7034, lr_0 = 9.7476e-04
Loss = 1.1378e-02, PNorm = 98.9133, GNorm = 0.3923, lr_0 = 9.7474e-04
Validation auc = 0.666794
Epoch 524
Validation auc = 0.666957
Epoch 525
Validation auc = 0.665595
Epoch 526
Validation auc = 0.663196
Epoch 527
Validation auc = 0.664886
Epoch 528
Loss = 2.1530e-02, PNorm = 99.2164, GNorm = 0.2329, lr_0 = 9.7452e-04
Validation auc = 0.672082
Epoch 529
Validation auc = 0.677370
Epoch 530
Validation auc = 0.685984
Epoch 531
Validation auc = 0.689473
Epoch 532
Validation auc = 0.689473
Epoch 533
Loss = 2.3814e-02, PNorm = 99.4290, GNorm = 0.6777, lr_0 = 9.7426e-04
Validation auc = 0.685766
Epoch 534
Validation auc = 0.685929
Epoch 535
Validation auc = 0.684566
Epoch 536
Validation auc = 0.682985
Epoch 537
Loss = 3.9371e-03, PNorm = 99.5484, GNorm = 0.1076, lr_0 = 9.7403e-04
Loss = 2.3985e-03, PNorm = 99.5549, GNorm = 0.0864, lr_0 = 9.7401e-04
Validation auc = 0.681241
Epoch 538
Validation auc = 0.677915
Epoch 539
Validation auc = 0.674644
Epoch 540
Validation auc = 0.671046
Epoch 541
Validation auc = 0.668975
Epoch 542
Loss = 1.3049e-03, PNorm = 99.6285, GNorm = 0.0232, lr_0 = 9.7379e-04
Validation auc = 0.667394
Epoch 543
Validation auc = 0.667339
Epoch 544
Validation auc = 0.666085
Epoch 545
Validation auc = 0.666576
Epoch 546
Validation auc = 0.664068
Epoch 547
Loss = 7.5035e-03, PNorm = 99.6820, GNorm = 0.2629, lr_0 = 9.7353e-04
Validation auc = 0.663196
Epoch 548
Validation auc = 0.664232
Epoch 549
Validation auc = 0.666467
Epoch 550
Validation auc = 0.668756
Epoch 551
Loss = 3.2647e-03, PNorm = 99.7348, GNorm = 0.0762, lr_0 = 9.7331e-04
Loss = 1.5431e-04, PNorm = 99.7382, GNorm = 0.0049, lr_0 = 9.7329e-04
Validation auc = 0.669683
Epoch 552
Validation auc = 0.669901
Epoch 553
Validation auc = 0.672409
Epoch 554
Validation auc = 0.687347
Epoch 555
Validation auc = 0.704247
Epoch 556
Loss = 3.2677e-02, PNorm = 99.9598, GNorm = 0.8976, lr_0 = 9.7305e-04
Loss = 6.7715e-02, PNorm = 100.0046, GNorm = 3.1127, lr_0 = 9.7303e-04
Validation auc = 0.697650
Epoch 557
Validation auc = 0.708935
Epoch 558
Validation auc = 0.696833
Epoch 559
Validation auc = 0.673390
Epoch 560
Validation auc = 0.644224
Epoch 561
Loss = 1.7160e-01, PNorm = 100.8586, GNorm = 1.4123, lr_0 = 9.7281e-04
Validation auc = 0.639263
Epoch 562
Validation auc = 0.638936
Epoch 563
Validation auc = 0.638118
Epoch 564
Validation auc = 0.644987
Epoch 565
Validation auc = 0.648967
Epoch 566
Loss = 1.4364e-01, PNorm = 101.5627, GNorm = 2.7627, lr_0 = 9.7255e-04
Validation auc = 0.657090
Epoch 567
Validation auc = 0.669901
Epoch 568
Validation auc = 0.672682
Epoch 569
Validation auc = 0.670883
Epoch 570
Loss = 2.9427e-02, PNorm = 102.1061, GNorm = 0.7492, lr_0 = 9.7232e-04
Loss = 8.5579e-03, PNorm = 102.1417, GNorm = 0.1338, lr_0 = 9.7231e-04
Validation auc = 0.661288
Epoch 571
Validation auc = 0.653328
Epoch 572
Validation auc = 0.648476
Epoch 573
Validation auc = 0.646350
Epoch 574
Validation auc = 0.646078
Epoch 575
Loss = 2.3102e-02, PNorm = 102.4539, GNorm = 0.3534, lr_0 = 9.7208e-04
Validation auc = 0.645205
Epoch 576
Validation auc = 0.644388
Epoch 577
Validation auc = 0.638391
Epoch 578
Validation auc = 0.621054
Epoch 579
Validation auc = 0.591615
Epoch 580
Loss = 1.6658e-02, PNorm = 102.6052, GNorm = 0.5432, lr_0 = 9.7182e-04
Validation auc = 0.599084
Epoch 581
Validation auc = 0.614240
Epoch 582
Validation auc = 0.632557
Epoch 583
Validation auc = 0.643570
Epoch 584
Loss = 1.2977e-02, PNorm = 102.6830, GNorm = 0.2315, lr_0 = 9.7160e-04
Loss = 3.3926e-03, PNorm = 102.6886, GNorm = 0.0932, lr_0 = 9.7158e-04
Validation auc = 0.651420
Epoch 585
Validation auc = 0.656054
Epoch 586
Validation auc = 0.659925
Epoch 587
Validation auc = 0.660688
Epoch 588
Validation auc = 0.661560
Epoch 589
Loss = 2.7164e-03, PNorm = 102.7464, GNorm = 0.0143, lr_0 = 9.7134e-04
Loss = 1.2494e-04, PNorm = 102.7489, GNorm = 0.0052, lr_0 = 9.7132e-04
Validation auc = 0.662051
Epoch 590
Validation auc = 0.658180
Epoch 591
Validation auc = 0.655563
Epoch 592
Validation auc = 0.656763
Epoch 593
Validation auc = 0.655781
Epoch 594
Loss = 2.2117e-02, PNorm = 102.7726, GNorm = 0.5342, lr_0 = 9.7110e-04
Validation auc = 0.645805
Epoch 595
Validation auc = 0.631467
Epoch 596
Validation auc = 0.617238
Epoch 597
Validation auc = 0.608516
Epoch 598
Validation auc = 0.603718
Epoch 599
Loss = 2.2776e-03, PNorm = 102.8210, GNorm = 0.0505, lr_0 = 9.7084e-04
Validation auc = 0.599302
Epoch 600
Validation auc = 0.596522
Epoch 601
Validation auc = 0.597558
Epoch 602
Validation auc = 0.602137
Epoch 603
Loss = 1.4953e-03, PNorm = 102.8502, GNorm = 0.0525, lr_0 = 9.7062e-04
Loss = 2.3895e-03, PNorm = 102.8525, GNorm = 0.0802, lr_0 = 9.7060e-04
Validation auc = 0.606607
Epoch 604
Validation auc = 0.609606
Epoch 605
Validation auc = 0.613640
Epoch 606
Validation auc = 0.616748
Epoch 607
Validation auc = 0.618110
Epoch 608
Loss = 4.7335e-02, PNorm = 102.8767, GNorm = 0.9278, lr_0 = 9.7036e-04
Validation auc = 0.617456
Epoch 609
Validation auc = 0.616802
Epoch 610
Validation auc = 0.617238
Epoch 611
Validation auc = 0.619146
Epoch 612
Validation auc = 0.619528
Epoch 613
Loss = 8.3143e-03, PNorm = 102.9103, GNorm = 0.3113, lr_0 = 9.7012e-04
Validation auc = 0.620836
Epoch 614
Validation auc = 0.618492
Epoch 615
Validation auc = 0.617565
Epoch 616
Validation auc = 0.619201
Epoch 617
Loss = 1.2302e-02, PNorm = 102.9404, GNorm = 0.0182, lr_0 = 9.6990e-04
Loss = 1.0596e-04, PNorm = 102.9421, GNorm = 0.0033, lr_0 = 9.6988e-04
Validation auc = 0.621709
Epoch 618
Validation auc = 0.626124
Epoch 619
Validation auc = 0.625852
Epoch 620
Validation auc = 0.625852
Epoch 621
Validation auc = 0.627051
Epoch 622
Loss = 1.5604e-03, PNorm = 102.9637, GNorm = 0.0451, lr_0 = 9.6964e-04
Loss = 6.9109e-04, PNorm = 102.9648, GNorm = 0.0239, lr_0 = 9.6962e-04
Validation auc = 0.627433
Epoch 623
Validation auc = 0.627869
Epoch 624
Validation auc = 0.627542
Epoch 625
Validation auc = 0.627596
Epoch 626
Validation auc = 0.629395
Epoch 627
Loss = 1.3497e-04, PNorm = 102.9900, GNorm = 0.0035, lr_0 = 9.6940e-04
Validation auc = 0.632884
Epoch 628
Validation auc = 0.636864
Epoch 629
Validation auc = 0.639536
Epoch 630
Validation auc = 0.639808
Epoch 631
Validation auc = 0.634847
Epoch 632
Loss = 3.3034e-04, PNorm = 103.0207, GNorm = 0.0086, lr_0 = 9.6914e-04
Validation auc = 0.631522
Epoch 633
Validation auc = 0.630159
Epoch 634
Validation auc = 0.629504
Epoch 635
Validation auc = 0.627923
Epoch 636
Loss = 2.3021e-03, PNorm = 103.0416, GNorm = 0.0313, lr_0 = 9.6892e-04
Loss = 1.8487e-03, PNorm = 103.0432, GNorm = 0.0724, lr_0 = 9.6890e-04
Validation auc = 0.627705
Epoch 637
Validation auc = 0.623071
Epoch 638
Validation auc = 0.618383
Epoch 639
Validation auc = 0.615330
Epoch 640
Validation auc = 0.613477
Epoch 641
Loss = 8.2758e-03, PNorm = 103.0728, GNorm = 0.2862, lr_0 = 9.6866e-04
Validation auc = 0.613313
Epoch 642
Validation auc = 0.613477
Epoch 643
Validation auc = 0.612059
Epoch 644
Validation auc = 0.610969
Epoch 645
Validation auc = 0.610914
Epoch 646
Loss = 7.3141e-03, PNorm = 103.1137, GNorm = 0.3942, lr_0 = 9.6842e-04
Validation auc = 0.609606
Epoch 647
Validation auc = 0.609933
Epoch 648
Validation auc = 0.609388
Epoch 649
Validation auc = 0.607371
Epoch 650
Loss = 9.9113e-04, PNorm = 103.1335, GNorm = 0.0374, lr_0 = 9.6820e-04
Loss = 6.6818e-04, PNorm = 103.1348, GNorm = 0.0238, lr_0 = 9.6818e-04
Validation auc = 0.605190
Epoch 651
Validation auc = 0.603554
Epoch 652
Validation auc = 0.603554
Epoch 653
Validation auc = 0.603118
Epoch 654
Validation auc = 0.602955
Epoch 655
Loss = 4.9430e-03, PNorm = 103.1597, GNorm = 0.3516, lr_0 = 9.6794e-04
Loss = 3.8290e-04, PNorm = 103.1613, GNorm = 0.0126, lr_0 = 9.6792e-04
Validation auc = 0.603554
Epoch 656
Validation auc = 0.604972
Epoch 657
Validation auc = 0.605953
Epoch 658
Validation auc = 0.606171
Epoch 659
Validation auc = 0.606662
Epoch 660
Loss = 7.7492e-04, PNorm = 103.1780, GNorm = 0.0483, lr_0 = 9.6770e-04
Validation auc = 0.608352
Epoch 661
Validation auc = 0.610042
Epoch 662
Validation auc = 0.610969
Epoch 663
Validation auc = 0.607425
Epoch 664
Validation auc = 0.604645
Epoch 665
Loss = 2.0548e-03, PNorm = 103.1943, GNorm = 0.0726, lr_0 = 9.6744e-04
Validation auc = 0.600665
Epoch 666
Validation auc = 0.596249
Epoch 667
Validation auc = 0.595268
Epoch 668
Validation auc = 0.594396
Epoch 669
Loss = 1.2274e-03, PNorm = 103.2195, GNorm = 0.0112, lr_0 = 9.6722e-04
Loss = 1.3609e-04, PNorm = 103.2209, GNorm = 0.0052, lr_0 = 9.6720e-04
Validation auc = 0.593632
Epoch 670
Validation auc = 0.593196
Epoch 671
Validation auc = 0.593414
Epoch 672
Validation auc = 0.593414
Epoch 673
Validation auc = 0.593414
Epoch 674
Loss = 1.5666e-04, PNorm = 103.2339, GNorm = 0.0055, lr_0 = 9.6696e-04
Validation auc = 0.593578
Epoch 675
Validation auc = 0.593960
Epoch 676
Validation auc = 0.595104
Epoch 677
Validation auc = 0.596576
Epoch 678
Validation auc = 0.597012
Epoch 679
Loss = 2.2547e-04, PNorm = 103.2435, GNorm = 0.0061, lr_0 = 9.6672e-04
Validation auc = 0.598048
Epoch 680
Validation auc = 0.598593
Epoch 681
Validation auc = 0.601319
Epoch 682
Validation auc = 0.603773
Epoch 683
Loss = 9.7369e-04, PNorm = 103.2511, GNorm = 0.0059, lr_0 = 9.6648e-04
Validation auc = 0.605735
Epoch 684
Validation auc = 0.607098
Epoch 685
Validation auc = 0.608679
Epoch 686
Validation auc = 0.609442
Epoch 687
Validation auc = 0.610369
Epoch 688
Loss = 5.7217e-04, PNorm = 103.2878, GNorm = 0.0081, lr_0 = 9.6624e-04
Loss = 1.2981e-04, PNorm = 103.2897, GNorm = 0.0048, lr_0 = 9.6622e-04
Validation auc = 0.611841
Epoch 689
Validation auc = 0.612713
Epoch 690
Validation auc = 0.612986
Epoch 691
Validation auc = 0.613531
Epoch 692
Validation auc = 0.613422
Epoch 693
Loss = 5.0269e-04, PNorm = 103.3069, GNorm = 0.0193, lr_0 = 9.6600e-04
Validation auc = 0.613313
Epoch 694
Validation auc = 0.613531
Epoch 695
Validation auc = 0.613640
Epoch 696
Validation auc = 0.614131
Epoch 697
Validation auc = 0.614294
Epoch 698
Loss = 3.1486e-04, PNorm = 103.3149, GNorm = 0.0159, lr_0 = 9.6574e-04
Validation auc = 0.614294
Epoch 699
Validation auc = 0.557297
Epoch 700
Validation auc = 0.693998
Epoch 701
Validation auc = 0.697705
Epoch 702
Loss = 5.0975e-02, PNorm = 103.3848, GNorm = 1.2815, lr_0 = 9.6552e-04
Loss = 5.8138e-02, PNorm = 103.4047, GNorm = 2.4489, lr_0 = 9.6550e-04
Validation auc = 0.692144
Epoch 703
Validation auc = 0.681950
Epoch 704
Validation auc = 0.674208
Epoch 705
Validation auc = 0.667121
Epoch 706
Validation auc = 0.659162
Epoch 707
Loss = 8.3550e-03, PNorm = 103.6676, GNorm = 0.2961, lr_0 = 9.6526e-04
Loss = 1.3471e-02, PNorm = 103.6844, GNorm = 0.8175, lr_0 = 9.6525e-04
Validation auc = 0.654255
Epoch 708
Validation auc = 0.654855
Epoch 709
Validation auc = 0.653110
Epoch 710
Validation auc = 0.652783
Epoch 711
Validation auc = 0.653492
Epoch 712
Loss = 4.8369e-03, PNorm = 103.8350, GNorm = 0.1576, lr_0 = 9.6502e-04
Validation auc = 0.656163
Epoch 713
Validation auc = 0.667666
Epoch 714
Validation auc = 0.672300
Epoch 715
Validation auc = 0.677752
Epoch 716
Loss = 2.6977e-03, PNorm = 103.9149, GNorm = 0.0294, lr_0 = 9.6479e-04
Validation auc = 0.682222
Epoch 717
Validation auc = 0.684021
Epoch 718
Validation auc = 0.686474
Epoch 719
Validation auc = 0.688273
Epoch 720
Validation auc = 0.690563
Epoch 721
Loss = 1.2492e-03, PNorm = 103.9997, GNorm = 0.0245, lr_0 = 9.6455e-04
Loss = 7.9297e-04, PNorm = 104.0045, GNorm = 0.0381, lr_0 = 9.6453e-04
Validation auc = 0.691108
Epoch 722
Validation auc = 0.691108
Epoch 723
Validation auc = 0.688819
Epoch 724
Validation auc = 0.688382
Epoch 725
Validation auc = 0.688110
Epoch 726
Loss = 5.8954e-04, PNorm = 104.0559, GNorm = 0.0162, lr_0 = 9.6431e-04
Validation auc = 0.688437
Epoch 727
Validation auc = 0.689418
Epoch 728
Validation auc = 0.690509
Epoch 729
Validation auc = 0.690836
Epoch 730
Validation auc = 0.691490
Epoch 731
Loss = 4.3051e-04, PNorm = 104.0974, GNorm = 0.0115, lr_0 = 9.6405e-04
Validation auc = 0.691653
Epoch 732
Validation auc = 0.690018
Epoch 733
Validation auc = 0.688001
Epoch 734
Validation auc = 0.682113
Epoch 735
Loss = 5.6510e-03, PNorm = 104.1104, GNorm = 0.2913, lr_0 = 9.6383e-04
Loss = 5.1090e-04, PNorm = 104.1132, GNorm = 0.0196, lr_0 = 9.6381e-04
Validation auc = 0.673717
Epoch 736
Validation auc = 0.673608
Epoch 737
Validation auc = 0.674699
Epoch 738
Validation auc = 0.674699
Epoch 739
Validation auc = 0.674263
Epoch 740
Loss = 5.1452e-03, PNorm = 104.1544, GNorm = 0.4334, lr_0 = 9.6357e-04
Loss = 7.1723e-04, PNorm = 104.1561, GNorm = 0.0258, lr_0 = 9.6355e-04
Validation auc = 0.676116
Epoch 741
Validation auc = 0.677861
Epoch 742
Validation auc = 0.678351
Epoch 743
Validation auc = 0.679496
Epoch 744
Validation auc = 0.679496
Epoch 745
Loss = 3.2346e-03, PNorm = 104.1926, GNorm = 0.0974, lr_0 = 9.6333e-04
Validation auc = 0.680096
Epoch 746
Validation auc = 0.679932
Epoch 747
Validation auc = 0.679387
Epoch 748
Validation auc = 0.678788
Epoch 749
Loss = 2.8428e-04, PNorm = 104.2155, GNorm = 0.0028, lr_0 = 9.6309e-04
Validation auc = 0.679060
Epoch 750
Validation auc = 0.679060
Epoch 751
Validation auc = 0.678897
Epoch 752
Validation auc = 0.679006
Epoch 753
Validation auc = 0.679169
Epoch 754
Loss = 2.1768e-04, PNorm = 104.2257, GNorm = 0.0057, lr_0 = 9.6285e-04
Loss = 3.9232e-04, PNorm = 104.2264, GNorm = 0.0159, lr_0 = 9.6284e-04
Validation auc = 0.679060
Epoch 755
Validation auc = 0.682386
Epoch 756
Validation auc = 0.686611
Epoch 757
Validation auc = 0.683476
Epoch 758
Validation auc = 0.677861
Epoch 759
Loss = 6.8309e-04, PNorm = 104.2693, GNorm = 0.0126, lr_0 = 9.6262e-04
Validation auc = 0.675844
Epoch 760
Validation auc = 0.675462
Epoch 761
Validation auc = 0.673336
Epoch 762
Validation auc = 0.672082
Epoch 763
Validation auc = 0.670883
Epoch 764
Loss = 3.0222e-03, PNorm = 104.3436, GNorm = 0.1321, lr_0 = 9.6236e-04
Validation auc = 0.669738
Epoch 765
Validation auc = 0.669465
Epoch 766
Validation auc = 0.668647
Epoch 767
Validation auc = 0.669193
Epoch 768
Loss = 1.6882e-03, PNorm = 104.3624, GNorm = 0.1043, lr_0 = 9.6214e-04
Loss = 3.9476e-03, PNorm = 104.3644, GNorm = 0.1017, lr_0 = 9.6212e-04
Validation auc = 0.670283
Epoch 769
Validation auc = 0.671319
Epoch 770
Validation auc = 0.671155
Epoch 771
Validation auc = 0.670665
Epoch 772
Validation auc = 0.670228
Epoch 773
Loss = 6.8994e-04, PNorm = 104.3991, GNorm = 0.0147, lr_0 = 9.6188e-04
Loss = 9.6253e-04, PNorm = 104.4020, GNorm = 0.0367, lr_0 = 9.6186e-04
Validation auc = 0.670610
Epoch 774
Validation auc = 0.669901
Epoch 775
Validation auc = 0.669084
Epoch 776
Validation auc = 0.669574
Epoch 777
Validation auc = 0.669356
Epoch 778
Loss = 1.1250e-03, PNorm = 104.4260, GNorm = 0.0458, lr_0 = 9.6164e-04
Validation auc = 0.669683
Epoch 779
Validation auc = 0.670774
Epoch 780
Validation auc = 0.671401
Epoch 781
Validation auc = 0.669465
Epoch 782
Validation auc = 0.665213
Epoch 783
Loss = 7.1934e-04, PNorm = 104.4401, GNorm = 0.0201, lr_0 = 9.6139e-04
Validation auc = 0.661397
Epoch 784
Validation auc = 0.660034
Epoch 785
Validation auc = 0.659979
Epoch 786
Validation auc = 0.659870
Epoch 787
Loss = 7.9198e-02, PNorm = 104.4602, GNorm = 0.8192, lr_0 = 9.6117e-04
Loss = 8.4666e-04, PNorm = 104.4619, GNorm = 0.0322, lr_0 = 9.6115e-04
Validation auc = 0.659816
Epoch 788
Validation auc = 0.660743
Epoch 789
Validation auc = 0.662433
Epoch 790
Validation auc = 0.662760
Epoch 791
Validation auc = 0.663305
Epoch 792
Loss = 9.9441e-03, PNorm = 104.4867, GNorm = 0.3992, lr_0 = 9.6093e-04
Validation auc = 0.664286
Epoch 793
Validation auc = 0.665376
Epoch 794
Validation auc = 0.666412
Epoch 795
Validation auc = 0.667066
Epoch 796
Validation auc = 0.667448
Epoch 797
Loss = 1.0030e-03, PNorm = 104.4970, GNorm = 0.0257, lr_0 = 9.6067e-04
Validation auc = 0.667339
Epoch 798
Validation auc = 0.667121
Epoch 799
Validation auc = 0.667230
Epoch 800
Validation auc = 0.667175
Epoch 801
Loss = 1.3941e-02, PNorm = 104.5084, GNorm = 0.0127, lr_0 = 9.6045e-04
Loss = 1.5788e-03, PNorm = 104.5098, GNorm = 0.0842, lr_0 = 9.6043e-04
Validation auc = 0.672027
Epoch 802
Validation auc = 0.675571
Epoch 803
Validation auc = 0.678515
Epoch 804
Validation auc = 0.679769
Epoch 805
Validation auc = 0.680205
Epoch 806
Loss = 7.4182e-04, PNorm = 104.5377, GNorm = 0.0136, lr_0 = 9.6019e-04
Loss = 1.0875e-04, PNorm = 104.5396, GNorm = 0.0047, lr_0 = 9.6018e-04
Validation auc = 0.680150
Epoch 807
Validation auc = 0.680150
Epoch 808
Validation auc = 0.680096
Epoch 809
Validation auc = 0.680150
Epoch 810
Validation auc = 0.680587
Epoch 811
Loss = 2.0423e-04, PNorm = 104.5660, GNorm = 0.0055, lr_0 = 9.5996e-04
Validation auc = 0.683312
Epoch 812
Validation auc = 0.687292
Epoch 813
Validation auc = 0.689636
Epoch 814
Validation auc = 0.692144
Epoch 815
Validation auc = 0.694052
Epoch 816
Loss = 1.9176e-02, PNorm = 104.6415, GNorm = 1.5416, lr_0 = 9.5970e-04
Validation auc = 0.682386
Epoch 817
Validation auc = 0.679360
Epoch 818
Validation auc = 0.678242
Epoch 819
Validation auc = 0.677098
Epoch 820
Loss = 1.6948e-04, PNorm = 104.6937, GNorm = 0.0047, lr_0 = 9.5948e-04
Loss = 3.3330e-04, PNorm = 104.6966, GNorm = 0.0077, lr_0 = 9.5946e-04
Validation auc = 0.676443
Epoch 821
Validation auc = 0.676253
Epoch 822
Validation auc = 0.676225
Epoch 823
Validation auc = 0.675980
Epoch 824
Validation auc = 0.675816
Epoch 825
Loss = 9.1238e-05, PNorm = 104.7185, GNorm = 0.0025, lr_0 = 9.5924e-04
Validation auc = 0.676034
Epoch 826
Validation auc = 0.675953
Epoch 827
Validation auc = 0.676116
Epoch 828
Validation auc = 0.676934
Epoch 829
Validation auc = 0.677943
Epoch 830
Loss = 5.7222e-04, PNorm = 104.7283, GNorm = 0.0299, lr_0 = 9.5899e-04
Validation auc = 0.678215
Epoch 831
Validation auc = 0.679224
Epoch 832
Validation auc = 0.680041
Epoch 833
Validation auc = 0.680205
Epoch 834
Loss = 2.6765e-04, PNorm = 104.7386, GNorm = 0.0070, lr_0 = 9.5877e-04
Loss = 2.7650e-04, PNorm = 104.7393, GNorm = 0.0105, lr_0 = 9.5875e-04
Validation auc = 0.680096
Epoch 835
Validation auc = 0.679796
Epoch 836
Validation auc = 0.680123
Epoch 837
Validation auc = 0.680505
Epoch 838
Validation auc = 0.680314
Epoch 839
Loss = 2.3543e-04, PNorm = 104.7467, GNorm = 0.0233, lr_0 = 9.5851e-04
Loss = 1.5298e-05, PNorm = 104.7471, GNorm = 0.0008, lr_0 = 9.5849e-04
Validation auc = 0.680369
Epoch 840
Validation auc = 0.680369
Epoch 841
Validation auc = 0.680205
Epoch 842
Validation auc = 0.670964
Epoch 843
Validation auc = 0.656763
Epoch 844
Loss = 6.5403e-04, PNorm = 104.7599, GNorm = 0.0203, lr_0 = 9.5827e-04
Validation auc = 0.643542
Epoch 845
Validation auc = 0.635474
Epoch 846
Validation auc = 0.641089
Epoch 847
Validation auc = 0.650085
Epoch 848
Validation auc = 0.656572
Epoch 849
Loss = 6.9177e-04, PNorm = 104.7833, GNorm = 0.0197, lr_0 = 9.5802e-04
Validation auc = 0.660388
Epoch 850
Validation auc = 0.663714
Epoch 851
Validation auc = 0.665704
Epoch 852
Validation auc = 0.667339
Epoch 853
Loss = 1.1454e-04, PNorm = 104.7930, GNorm = 0.0046, lr_0 = 9.5780e-04
Loss = 3.2899e-05, PNorm = 104.7934, GNorm = 0.0014, lr_0 = 9.5778e-04
Validation auc = 0.667993
Epoch 854
Validation auc = 0.668593
Epoch 855
Validation auc = 0.668975
Epoch 856
Validation auc = 0.669247
Epoch 857
Validation auc = 0.669547
Epoch 858
Loss = 5.8267e-05, PNorm = 104.7970, GNorm = 0.0008, lr_0 = 9.5754e-04
Validation auc = 0.669656
Epoch 859
Validation auc = 0.669929
Epoch 860
Validation auc = 0.670092
Epoch 861
Validation auc = 0.670092
Epoch 862
Validation auc = 0.670092
Epoch 863
Loss = 4.2644e-05, PNorm = 104.7986, GNorm = 0.0010, lr_0 = 9.5730e-04
Validation auc = 0.670201
Epoch 864
Validation auc = 0.670310
Epoch 865
Validation auc = 0.670310
Epoch 866
Validation auc = 0.670365
Epoch 867
Loss = 1.8554e-04, PNorm = 104.7998, GNorm = 0.0072, lr_0 = 9.5708e-04
Loss = 2.1576e-05, PNorm = 104.7999, GNorm = 0.0007, lr_0 = 9.5707e-04
Validation auc = 0.670528
Epoch 868
Validation auc = 0.670365
Epoch 869
Validation auc = 0.670365
Epoch 870
Validation auc = 0.673172
Epoch 871
Validation auc = 0.671864
Epoch 872
Loss = 4.3217e-03, PNorm = 104.8018, GNorm = 0.0020, lr_0 = 9.5683e-04
Loss = 1.1240e-04, PNorm = 104.8032, GNorm = 0.0042, lr_0 = 9.5681e-04
Validation auc = 0.669847
Epoch 873
Validation auc = 0.669056
Epoch 874
Validation auc = 0.669165
Epoch 875
Validation auc = 0.669411
Epoch 876
Validation auc = 0.669111
Epoch 877
Loss = 1.2299e-04, PNorm = 104.8173, GNorm = 0.0028, lr_0 = 9.5659e-04
Validation auc = 0.668511
Epoch 878
Validation auc = 0.668511
Epoch 879
Validation auc = 0.668348
Epoch 880
Validation auc = 0.668184
Epoch 881
Validation auc = 0.667339
Epoch 882
Loss = 9.0376e-05, PNorm = 104.8237, GNorm = 0.0030, lr_0 = 9.5634e-04
Validation auc = 0.666303
Epoch 883
Validation auc = 0.665431
Epoch 884
Validation auc = 0.665131
Epoch 885
Validation auc = 0.664586
Epoch 886
Loss = 8.9782e-05, PNorm = 104.8264, GNorm = 0.0014, lr_0 = 9.5612e-04
Loss = 7.0444e-04, PNorm = 104.8268, GNorm = 0.0289, lr_0 = 9.5610e-04
Validation auc = 0.666249
Epoch 887
Validation auc = 0.666685
Epoch 888
Validation auc = 0.666576
Epoch 889
Validation auc = 0.666739
Epoch 890
Validation auc = 0.666467
Epoch 891
Loss = 1.4213e-04, PNorm = 104.8314, GNorm = 0.0032, lr_0 = 9.5586e-04
Validation auc = 0.667339
Epoch 892
Validation auc = 0.668702
Epoch 893
Validation auc = 0.669956
Epoch 894
Validation auc = 0.668484
Epoch 895
Validation auc = 0.668593
Epoch 896
Loss = 1.3548e-04, PNorm = 104.8397, GNorm = 0.0068, lr_0 = 9.5563e-04
Validation auc = 0.670228
Epoch 897
Validation auc = 0.671918
Epoch 898
Validation auc = 0.674154
Epoch 899
Validation auc = 0.676225
Epoch 900
Loss = 1.3474e-03, PNorm = 104.8576, GNorm = 0.1176, lr_0 = 9.5541e-04
Loss = 3.1793e-02, PNorm = 104.8684, GNorm = 1.6951, lr_0 = 9.5539e-04
Validation auc = 0.675244
Epoch 901
Validation auc = 0.664232
Epoch 902
Validation auc = 0.654419
Epoch 903
Validation auc = 0.646950
Epoch 904
Validation auc = 0.651965
Epoch 905
Loss = 2.1542e-03, PNorm = 105.0426, GNorm = 0.1495, lr_0 = 9.5515e-04
Loss = 7.1041e-04, PNorm = 105.0549, GNorm = 0.0297, lr_0 = 9.5513e-04
Validation auc = 0.656654
Epoch 906
Validation auc = 0.658616
Epoch 907
Validation auc = 0.660797
Epoch 908
Validation auc = 0.661397
Epoch 909
Validation auc = 0.663795
Epoch 910
Loss = 7.1614e-04, PNorm = 105.1807, GNorm = 0.0147, lr_0 = 9.5491e-04
Validation auc = 0.664995
Epoch 911
Validation auc = 0.666140
Epoch 912
Validation auc = 0.666031
Epoch 913
Validation auc = 0.665976
Epoch 914
Validation auc = 0.669247
Epoch 915
Loss = 8.3196e-02, PNorm = 105.2331, GNorm = 0.8161, lr_0 = 9.5466e-04
Validation auc = 0.672954
Epoch 916
Validation auc = 0.679333
Epoch 917
Validation auc = 0.686965
Epoch 918
Validation auc = 0.689909
Epoch 919
Loss = 6.4847e-04, PNorm = 105.2867, GNorm = 0.0156, lr_0 = 9.5444e-04
Loss = 1.4062e-04, PNorm = 105.2906, GNorm = 0.0051, lr_0 = 9.5442e-04
Validation auc = 0.692144
Epoch 920
Validation auc = 0.693725
Epoch 921
Validation auc = 0.694706
Epoch 922
Validation auc = 0.696233
Epoch 923
Validation auc = 0.697705
Epoch 924
Loss = 3.9779e-04, PNorm = 105.3270, GNorm = 0.0091, lr_0 = 9.5419e-04
Validation auc = 0.698250
Epoch 925
Validation auc = 0.696942
Epoch 926
Validation auc = 0.696287
Epoch 927
Validation auc = 0.695960
Epoch 928
Validation auc = 0.695797
Epoch 929
Loss = 2.0028e-04, PNorm = 105.3451, GNorm = 0.0050, lr_0 = 9.5395e-04
Validation auc = 0.695906
Epoch 930
Validation auc = 0.697323
Epoch 931
Validation auc = 0.698850
Epoch 932
Validation auc = 0.698195
Epoch 933
Loss = 6.8706e-04, PNorm = 105.3603, GNorm = 0.0031, lr_0 = 9.5371e-04
Validation auc = 0.697323
Epoch 934
Validation auc = 0.695797
Epoch 935
Validation auc = 0.695361
Epoch 936
Validation auc = 0.694379
Epoch 937
Validation auc = 0.692962
Epoch 938
Loss = 2.9068e-04, PNorm = 105.3742, GNorm = 0.0097, lr_0 = 9.5348e-04
Loss = 4.6390e-05, PNorm = 105.3749, GNorm = 0.0018, lr_0 = 9.5346e-04
Validation auc = 0.692362
Epoch 939
Validation auc = 0.691981
Epoch 940
Validation auc = 0.691763
Epoch 941
Validation auc = 0.691708
Epoch 942
Validation auc = 0.691490
Epoch 943
Loss = 5.8212e-05, PNorm = 105.3817, GNorm = 0.0016, lr_0 = 9.5324e-04
Validation auc = 0.691490
Epoch 944
Validation auc = 0.690945
Epoch 945
Validation auc = 0.690509
Epoch 946
Validation auc = 0.690236
Epoch 947
Validation auc = 0.690018
Epoch 948
Loss = 1.4923e-04, PNorm = 105.3866, GNorm = 0.0032, lr_0 = 9.5299e-04
Validation auc = 0.690127
Epoch 949
Validation auc = 0.690509
Epoch 950
Validation auc = 0.690400
Epoch 951
Validation auc = 0.690454
Epoch 952
Loss = 8.7516e-05, PNorm = 105.3891, GNorm = 0.0014, lr_0 = 9.5277e-04
Loss = 1.2040e-05, PNorm = 105.3893, GNorm = 0.0006, lr_0 = 9.5275e-04
Validation auc = 0.690400
Epoch 953
Validation auc = 0.690563
Epoch 954
Validation auc = 0.690509
Epoch 955
Validation auc = 0.695252
Epoch 956
Validation auc = 0.697214
Epoch 957
Loss = 9.0386e-03, PNorm = 105.4165, GNorm = 0.9422, lr_0 = 9.5251e-04
Loss = 2.4996e-04, PNorm = 105.4212, GNorm = 0.0169, lr_0 = 9.5250e-04
Validation auc = 0.694216
Epoch 958
Validation auc = 0.688110
Epoch 959
Validation auc = 0.684784
Epoch 960
Validation auc = 0.680859
Epoch 961
Validation auc = 0.678842
Epoch 962
Loss = 9.6231e-05, PNorm = 105.4747, GNorm = 0.0027, lr_0 = 9.5228e-04
Validation auc = 0.676879
Epoch 963
Validation auc = 0.675789
Epoch 964
Validation auc = 0.675571
Epoch 965
Validation auc = 0.675408
Epoch 966
Loss = 2.8418e-03, PNorm = 105.5187, GNorm = 0.0016, lr_0 = 9.5204e-04
Validation auc = 0.675898
Epoch 967
Validation auc = 0.675953
Epoch 968
Validation auc = 0.676225
Epoch 969
Validation auc = 0.676934
Epoch 970
Validation auc = 0.676879
Epoch 971
Loss = 7.1985e-04, PNorm = 105.5542, GNorm = 0.0489, lr_0 = 9.5180e-04
Loss = 5.6990e-03, PNorm = 105.5552, GNorm = 0.2836, lr_0 = 9.5179e-04
Validation auc = 0.677370
Epoch 972
Validation auc = 0.678079
Epoch 973
Validation auc = 0.678624
Epoch 974
Validation auc = 0.678733
Epoch 975
Validation auc = 0.679060
Epoch 976
Loss = 3.9111e-04, PNorm = 105.5643, GNorm = 0.0097, lr_0 = 9.5157e-04
Validation auc = 0.679006
Epoch 977
Validation auc = 0.679278
Epoch 978
Validation auc = 0.679878
Epoch 979
Validation auc = 0.680041
Epoch 980
Validation auc = 0.680205
Epoch 981
Loss = 2.7605e-04, PNorm = 105.5711, GNorm = 0.0058, lr_0 = 9.5132e-04
Validation auc = 0.680259
Epoch 982
Validation auc = 0.680750
Epoch 983
Validation auc = 0.680805
Epoch 984
Validation auc = 0.681077
Epoch 985
Loss = 1.9978e-04, PNorm = 105.5756, GNorm = 0.0049, lr_0 = 9.5110e-04
Loss = 1.8416e-04, PNorm = 105.5759, GNorm = 0.0068, lr_0 = 9.5108e-04
Validation auc = 0.681350
Epoch 986
Validation auc = 0.681295
Epoch 987
Validation auc = 0.681295
Epoch 988
Validation auc = 0.680314
Epoch 989
Validation auc = 0.679387
Epoch 990
Loss = 6.6695e-04, PNorm = 105.5857, GNorm = 0.0281, lr_0 = 9.5084e-04
Loss = 2.9661e-05, PNorm = 105.5868, GNorm = 0.0016, lr_0 = 9.5083e-04
Validation auc = 0.679333
Epoch 991
Validation auc = 0.680041
Epoch 992
Validation auc = 0.680150
Epoch 993
Validation auc = 0.679823
Epoch 994
Validation auc = 0.679987
Epoch 995
Loss = 1.5644e-04, PNorm = 105.6022, GNorm = 0.0046, lr_0 = 9.5061e-04
Validation auc = 0.680096
Epoch 996
Validation auc = 0.680696
Epoch 997
Validation auc = 0.680859
Epoch 998
Validation auc = 0.680750
Epoch 999
Loss = 1.4699e-04, PNorm = 105.6122, GNorm = 0.0023, lr_0 = 9.5037e-04
Validation auc = 0.680859
Epoch 1000
Validation auc = 0.681023
Epoch 1001
Validation auc = 0.681350
Epoch 1002
Validation auc = 0.681186
Epoch 1003
Validation auc = 0.680750
Epoch 1004
Loss = 1.1824e-04, PNorm = 105.6166, GNorm = 0.0015, lr_0 = 9.5014e-04
Loss = 9.6011e-05, PNorm = 105.6168, GNorm = 0.0043, lr_0 = 9.5012e-04
Validation auc = 0.681077
Epoch 1005
Validation auc = 0.681186
Epoch 1006
Validation auc = 0.681404
Epoch 1007
Validation auc = 0.681513
Epoch 1008
Validation auc = 0.681895
Epoch 1009
Loss = 1.2580e-04, PNorm = 105.6197, GNorm = 0.0032, lr_0 = 9.4990e-04
Validation auc = 0.682004
Epoch 1010
Validation auc = 0.682004
Epoch 1011
Validation auc = 0.682004
Epoch 1012
Validation auc = 0.682222
Epoch 1013
Validation auc = 0.682549
Epoch 1014
Loss = 5.8083e-05, PNorm = 105.6232, GNorm = 0.0012, lr_0 = 9.4965e-04
Validation auc = 0.682604
Epoch 1015
Validation auc = 0.682658
Epoch 1016
Validation auc = 0.682604
Epoch 1017
Validation auc = 0.682549
Epoch 1018
Loss = 7.8085e-05, PNorm = 105.6256, GNorm = 0.0022, lr_0 = 9.4943e-04
Loss = 1.7881e-05, PNorm = 105.6257, GNorm = 0.0009, lr_0 = 9.4941e-04
Validation auc = 0.682658
Epoch 1019
Validation auc = 0.683040
Epoch 1020
Validation auc = 0.683531
Epoch 1021
Validation auc = 0.683912
Epoch 1022
Validation auc = 0.684621
Epoch 1023
Loss = 1.0299e-04, PNorm = 105.6273, GNorm = 0.0021, lr_0 = 9.4918e-04
Loss = 3.9832e-05, PNorm = 105.6274, GNorm = 0.0024, lr_0 = 9.4916e-04
Validation auc = 0.685221
Epoch 1024
Validation auc = 0.685548
Epoch 1025
Validation auc = 0.685657
Epoch 1026
Validation auc = 0.685493
Epoch 1027
Validation auc = 0.685493
Epoch 1028
Loss = 1.2650e-04, PNorm = 105.6295, GNorm = 0.0031, lr_0 = 9.4894e-04
Validation auc = 0.685493
Epoch 1029
Validation auc = 0.685439
Epoch 1030
Validation auc = 0.685493
Epoch 1031
Validation auc = 0.685439
Epoch 1032
Validation auc = 0.685493
Epoch 1033
Loss = 3.7659e-05, PNorm = 105.6321, GNorm = 0.0010, lr_0 = 9.4869e-04
Validation auc = 0.685602
Epoch 1034
Validation auc = 0.685548
Epoch 1035
Validation auc = 0.685602
Epoch 1036
Validation auc = 0.685602
Epoch 1037
Loss = 1.2464e-04, PNorm = 105.6341, GNorm = 0.0111, lr_0 = 9.4847e-04
Loss = 2.8530e-05, PNorm = 105.6343, GNorm = 0.0012, lr_0 = 9.4845e-04
Validation auc = 0.685493
Epoch 1038
Validation auc = 0.685384
Epoch 1039
Validation auc = 0.685602
Epoch 1040
Validation auc = 0.685657
Epoch 1041
Validation auc = 0.685548
Epoch 1042
Loss = 5.6193e-05, PNorm = 105.6361, GNorm = 0.0018, lr_0 = 9.4823e-04
Validation auc = 0.685929
Epoch 1043
Validation auc = 0.685929
Epoch 1044
Validation auc = 0.685875
Epoch 1045
Validation auc = 0.685984
Epoch 1046
Validation auc = 0.686202
Epoch 1047
Loss = 4.5815e-05, PNorm = 105.6378, GNorm = 0.0013, lr_0 = 9.4798e-04
Validation auc = 0.686256
Epoch 1048
Validation auc = 0.686256
Epoch 1049
Validation auc = 0.686365
Epoch 1050
Validation auc = 0.686311
Epoch 1051
Loss = 4.5096e-05, PNorm = 105.6392, GNorm = 0.0013, lr_0 = 9.4776e-04
Loss = 5.3481e-05, PNorm = 105.6394, GNorm = 0.0022, lr_0 = 9.4775e-04
Validation auc = 0.686202
Epoch 1052
Validation auc = 0.686202
Epoch 1053
Validation auc = 0.686256
Epoch 1054
Validation auc = 0.686256
Epoch 1055
Validation auc = 0.686311
Epoch 1056
Loss = 3.2980e-04, PNorm = 105.6409, GNorm = 0.0012, lr_0 = 9.4751e-04
Loss = 8.2067e-05, PNorm = 105.6410, GNorm = 0.0032, lr_0 = 9.4749e-04
Validation auc = 0.686202
Epoch 1057
Validation auc = 0.686256
Epoch 1058
Validation auc = 0.686256
Epoch 1059
Validation auc = 0.686420
Epoch 1060
Validation auc = 0.686420
Epoch 1061
Loss = 3.6446e-05, PNorm = 105.6437, GNorm = 0.0010, lr_0 = 9.4728e-04
Validation auc = 0.686420
Epoch 1062
Validation auc = 0.686856
Epoch 1063
Validation auc = 0.687347
Epoch 1064
Validation auc = 0.664123
Epoch 1065
Validation auc = 0.636973
Epoch 1066
Loss = 4.8615e-03, PNorm = 105.6516, GNorm = 0.8270, lr_0 = 9.4702e-04
Validation auc = 0.684730
Epoch 1067
Validation auc = 0.711116
Epoch 1068
Validation auc = 0.708009
Epoch 1069
Validation auc = 0.693453
Epoch 1070
Loss = 8.9285e-05, PNorm = 105.7294, GNorm = 0.0075, lr_0 = 9.4681e-04
Loss = 2.5628e-05, PNorm = 105.7362, GNorm = 0.0014, lr_0 = 9.4679e-04
Validation auc = 0.680369
Epoch 1071
Validation auc = 0.672082
Epoch 1072
Validation auc = 0.674917
Epoch 1073
Validation auc = 0.675517
Epoch 1074
Validation auc = 0.678951
Epoch 1075
Loss = 1.5181e-04, PNorm = 105.7929, GNorm = 0.0082, lr_0 = 9.4657e-04
Validation auc = 0.681622
Epoch 1076
Validation auc = 0.682985
Epoch 1077
Validation auc = 0.684948
Epoch 1078
Validation auc = 0.686202
Epoch 1079
Validation auc = 0.668429
Epoch 1080
Loss = 4.8082e-04, PNorm = 105.8162, GNorm = 0.0193, lr_0 = 9.4632e-04
Validation auc = 0.655727
Epoch 1081
Validation auc = 0.722728
Epoch 1082
Validation auc = 0.716949
Epoch 1083
Validation auc = 0.711934
Epoch 1084
Loss = 1.2308e-02, PNorm = 105.9721, GNorm = 0.0003, lr_0 = 9.4610e-04
Loss = 1.2925e-04, PNorm = 105.9889, GNorm = 0.0207, lr_0 = 9.4608e-04
Validation auc = 0.708390
Epoch 1085
Validation auc = 0.699558
Epoch 1086
Validation auc = 0.697759
Epoch 1087
Validation auc = 0.694706
Epoch 1088
Validation auc = 0.687728
Epoch 1089
Loss = 1.1340e-03, PNorm = 106.2688, GNorm = 0.0574, lr_0 = 9.4585e-04
Loss = 5.0203e-04, PNorm = 106.2846, GNorm = 0.0391, lr_0 = 9.4583e-04
Validation auc = 0.681404
Epoch 1090
Validation auc = 0.686583
Epoch 1091
Validation auc = 0.698795
Epoch 1092
Validation auc = 0.708009
Epoch 1093
Validation auc = 0.704465
Epoch 1094
Loss = 1.8772e-02, PNorm = 106.4592, GNorm = 0.8568, lr_0 = 9.4561e-04
Validation auc = 0.683640
Epoch 1095
Validation auc = 0.672736
Epoch 1096
Validation auc = 0.668593
Epoch 1097
Validation auc = 0.669520
Epoch 1098
Validation auc = 0.665758
Epoch 1099
Loss = 3.5592e-03, PNorm = 106.8456, GNorm = 0.0652, lr_0 = 9.4536e-04
Validation auc = 0.666031
Epoch 1100
Validation auc = 0.664286
Epoch 1101
Validation auc = 0.665704
Epoch 1102
Validation auc = 0.669084
Epoch 1103
Loss = 3.2510e-03, PNorm = 107.0691, GNorm = 0.0765, lr_0 = 9.4515e-04
Loss = 3.4209e-04, PNorm = 107.0828, GNorm = 0.0200, lr_0 = 9.4513e-04
Validation auc = 0.673772
Epoch 1104
Validation auc = 0.674590
Epoch 1105
Validation auc = 0.674208
Epoch 1106
Validation auc = 0.672137
Epoch 1107
Validation auc = 0.671155
Epoch 1108
Loss = 1.1514e-03, PNorm = 107.2071, GNorm = 0.0507, lr_0 = 9.4489e-04
Validation auc = 0.671264
Epoch 1109
Validation auc = 0.671918
Epoch 1110
Validation auc = 0.672246
Epoch 1111
Validation auc = 0.660579
Epoch 1112
Validation auc = 0.653710
Epoch 1113
Loss = 4.8710e-03, PNorm = 107.2738, GNorm = 0.2713, lr_0 = 9.4466e-04
Validation auc = 0.648313
Epoch 1114
Validation auc = 0.638173
Epoch 1115
Validation auc = 0.628905
Epoch 1116
Validation auc = 0.624707
Epoch 1117
Loss = 2.4321e-03, PNorm = 107.3975, GNorm = 0.0964, lr_0 = 9.4444e-04
Loss = 3.8215e-01, PNorm = 107.4127, GNorm = 11.7807, lr_0 = 9.4443e-04
Validation auc = 0.599139
Epoch 1118
Validation auc = 0.627487
Epoch 1119
Validation auc = 0.633539
Epoch 1120
Validation auc = 0.663577
Epoch 1121
Validation auc = 0.664722
Epoch 1122
Loss = 6.2070e-02, PNorm = 108.5038, GNorm = 0.9374, lr_0 = 9.4419e-04
Loss = 1.2418e-01, PNorm = 108.5768, GNorm = 5.3469, lr_0 = 9.4417e-04
Validation auc = 0.667830
Epoch 1123
Validation auc = 0.655727
Epoch 1124
Validation auc = 0.647004
Epoch 1125
Validation auc = 0.650930
Epoch 1126
Validation auc = 0.634411
Epoch 1127
Loss = 1.3995e-02, PNorm = 109.6432, GNorm = 0.4307, lr_0 = 9.4396e-04
Validation auc = 0.621436
Epoch 1128
Validation auc = 0.638336
Epoch 1129
Validation auc = 0.649458
Epoch 1130
Validation auc = 0.670283
Epoch 1131
Validation auc = 0.691544
Epoch 1132
Loss = 3.3868e-02, PNorm = 110.6069, GNorm = 0.5283, lr_0 = 9.4371e-04
Validation auc = 0.690890
Epoch 1133
Validation auc = 0.670610
Epoch 1134
Validation auc = 0.652729
Epoch 1135
Validation auc = 0.636101
Epoch 1136
Loss = 3.1054e-02, PNorm = 111.4339, GNorm = 1.3065, lr_0 = 9.4349e-04
Loss = 3.6641e-03, PNorm = 111.4807, GNorm = 0.0988, lr_0 = 9.4347e-04
Validation auc = 0.625743
Epoch 1137
Validation auc = 0.635883
Epoch 1138
Validation auc = 0.630867
Epoch 1139
Validation auc = 0.618329
Epoch 1140
Validation auc = 0.613149
Epoch 1141
Loss = 3.0820e-02, PNorm = 112.0456, GNorm = 1.5290, lr_0 = 9.4324e-04
Validation auc = 0.599193
Epoch 1142
Validation auc = 0.582893
Epoch 1143
Validation auc = 0.572753
Epoch 1144
Validation auc = 0.594341
Epoch 1145
Validation auc = 0.587199
Epoch 1146
Loss = 6.3349e-01, PNorm = 113.4566, GNorm = 3.5280, lr_0 = 9.4300e-04
Validation auc = 0.598593
Epoch 1147
Validation auc = 0.587854
Epoch 1148
Validation auc = 0.594123
Epoch 1149
Validation auc = 0.595050
Epoch 1150
Loss = 1.0879e-01, PNorm = 115.1062, GNorm = 0.6204, lr_0 = 9.4279e-04
Loss = 1.5817e-01, PNorm = 115.2020, GNorm = 2.4133, lr_0 = 9.4277e-04
Validation auc = 0.571553
Epoch 1151
Validation auc = 0.576187
Epoch 1152
Validation auc = 0.595377
Epoch 1153
Validation auc = 0.612986
Epoch 1154
Validation auc = 0.630867
Epoch 1155
Loss = 6.2518e-02, PNorm = 116.2008, GNorm = 1.0037, lr_0 = 9.4253e-04
Loss = 1.2874e-02, PNorm = 116.2576, GNorm = 0.2421, lr_0 = 9.4252e-04
Validation auc = 0.646568
Epoch 1156
Validation auc = 0.652238
Epoch 1157
Validation auc = 0.648531
Epoch 1158
Validation auc = 0.643134
Epoch 1159
Validation auc = 0.634411
Epoch 1160
Loss = 3.3492e-02, PNorm = 116.9273, GNorm = 0.3549, lr_0 = 9.4230e-04
Validation auc = 0.623944
Epoch 1161
Validation auc = 0.615766
Epoch 1162
Validation auc = 0.622308
Epoch 1163
Validation auc = 0.624434
Epoch 1164
Validation auc = 0.625852
Epoch 1165
Loss = 4.1978e-03, PNorm = 117.4371, GNorm = 0.0704, lr_0 = 9.4205e-04
Validation auc = 0.625797
Epoch 1166
Validation auc = 0.652456
Epoch 1167
Validation auc = 0.646895
Epoch 1168
Validation auc = 0.629668
Epoch 1169
Loss = 6.5953e-02, PNorm = 118.1129, GNorm = 0.8266, lr_0 = 9.4183e-04
Loss = 3.6275e-02, PNorm = 118.1867, GNorm = 0.7965, lr_0 = 9.4182e-04
Validation auc = 0.622962
Epoch 1170
Validation auc = 0.628032
Epoch 1171
Validation auc = 0.632612
Epoch 1172
Validation auc = 0.634029
Epoch 1173
Validation auc = 0.641335
Epoch 1174
Loss = 2.7891e-02, PNorm = 118.9359, GNorm = 0.3723, lr_0 = 9.4158e-04
Validation auc = 0.657144
Epoch 1175
Validation auc = 0.668866
Epoch 1176
Validation auc = 0.696233
Epoch 1177
Validation auc = 0.686311
Epoch 1178
Validation auc = 0.686692
Epoch 1179
Loss = 6.8323e-02, PNorm = 119.3833, GNorm = 1.0690, lr_0 = 9.4135e-04
Validation auc = 0.683476
Epoch 1180
Validation auc = 0.652074
Epoch 1181
Validation auc = 0.653764
Epoch 1182
Validation auc = 0.653655
Epoch 1183
Loss = 3.4265e-02, PNorm = 119.9020, GNorm = 0.0197, lr_0 = 9.4112e-04
Validation auc = 0.656000
Epoch 1184
Validation auc = 0.659216
Epoch 1185
Validation auc = 0.661342
Epoch 1186
Validation auc = 0.670719
Epoch 1187
Validation auc = 0.675244
Epoch 1188
Loss = 1.8578e-02, PNorm = 120.3342, GNorm = 0.2117, lr_0 = 9.4088e-04
Loss = 5.4570e-03, PNorm = 120.3563, GNorm = 0.1806, lr_0 = 9.4087e-04
Validation auc = 0.674535
Epoch 1189
Validation auc = 0.669520
Epoch 1190
Validation auc = 0.664777
Epoch 1191
Validation auc = 0.658453
Epoch 1192
Validation auc = 0.659816
Epoch 1193
Loss = 8.4670e-03, PNorm = 120.5464, GNorm = 0.2038, lr_0 = 9.4065e-04
Validation auc = 0.669792
Epoch 1194
Validation auc = 0.670283
Epoch 1195
Validation auc = 0.670446
Epoch 1196
Validation auc = 0.685330
Epoch 1197
Validation auc = 0.708336
Epoch 1198
Loss = 1.1052e-01, PNorm = 120.9260, GNorm = 0.8232, lr_0 = 9.4040e-04
Validation auc = 0.725672
Epoch 1199
Validation auc = 0.744698
Epoch 1200
Validation auc = 0.747042
Epoch 1201
Validation auc = 0.744480
Epoch 1202
Loss = 1.1450e-01, PNorm = 121.2792, GNorm = 0.7913, lr_0 = 9.4018e-04
Loss = 1.8604e-04, PNorm = 121.3008, GNorm = 0.0055, lr_0 = 9.4016e-04
Validation auc = 0.745734
Epoch 1203
Validation auc = 0.750204
Epoch 1204
Validation auc = 0.751240
Epoch 1205
Validation auc = 0.745898
Epoch 1206
Validation auc = 0.735267
Epoch 1207
Loss = 5.9865e-02, PNorm = 121.5380, GNorm = 0.7210, lr_0 = 9.3993e-04
Loss = 4.3423e-02, PNorm = 121.5498, GNorm = 1.9822, lr_0 = 9.3991e-04
Validation auc = 0.723219
Epoch 1208
Validation auc = 0.708336
Epoch 1209
Validation auc = 0.705555
Epoch 1210
Validation auc = 0.704956
Epoch 1211
Validation auc = 0.704683
Epoch 1212
Loss = 1.3894e-02, PNorm = 121.7301, GNorm = 0.3906, lr_0 = 9.3970e-04
Validation auc = 0.701848
Epoch 1213
Validation auc = 0.703593
Epoch 1214
Validation auc = 0.703865
Epoch 1215
Validation auc = 0.705828
Epoch 1216
Loss = 7.0019e-03, PNorm = 121.8492, GNorm = 0.0104, lr_0 = 9.3946e-04
Validation auc = 0.705937
Epoch 1217
Validation auc = 0.704683
Epoch 1218
Validation auc = 0.702066
Epoch 1219
Validation auc = 0.700485
Epoch 1220
Validation auc = 0.698686
Epoch 1221
Loss = 1.1403e-02, PNorm = 121.9346, GNorm = 0.0654, lr_0 = 9.3923e-04
Loss = 8.9617e-04, PNorm = 121.9396, GNorm = 0.0263, lr_0 = 9.3922e-04
Validation auc = 0.697487
Epoch 1222
Validation auc = 0.696287
Epoch 1223
Validation auc = 0.694979
Epoch 1224
Validation auc = 0.692962
Epoch 1225
Validation auc = 0.690836
Epoch 1226
Loss = 3.7794e-02, PNorm = 121.9923, GNorm = 1.8168, lr_0 = 9.3900e-04
Validation auc = 0.700431
Epoch 1227
Validation auc = 0.705065
Epoch 1228
Validation auc = 0.711879
Epoch 1229
Validation auc = 0.715695
Epoch 1230
Validation auc = 0.715641
Epoch 1231
Loss = 3.8995e-03, PNorm = 122.0760, GNorm = 0.1331, lr_0 = 9.3875e-04
Validation auc = 0.714660
Epoch 1232
Validation auc = 0.713515
Epoch 1233
Validation auc = 0.711607
Epoch 1234
Validation auc = 0.713351
Epoch 1235
Loss = 2.3044e-03, PNorm = 122.1600, GNorm = 0.1860, lr_0 = 9.3853e-04
Loss = 1.5690e-03, PNorm = 122.1650, GNorm = 0.0374, lr_0 = 9.3852e-04
Validation auc = 0.715150
Epoch 1236
Validation auc = 0.718585
Epoch 1237
Validation auc = 0.721856
Epoch 1238
Validation auc = 0.722074
Epoch 1239
Validation auc = 0.720656
Epoch 1240
Loss = 3.7322e-03, PNorm = 122.2083, GNorm = 0.0359, lr_0 = 9.3828e-04
Loss = 1.8237e-03, PNorm = 122.2115, GNorm = 0.0484, lr_0 = 9.3827e-04
Validation auc = 0.720002
Epoch 1241
Validation auc = 0.719130
Epoch 1242
Validation auc = 0.717931
Epoch 1243
Validation auc = 0.718312
Epoch 1244
Validation auc = 0.720820
Epoch 1245
Loss = 4.3009e-03, PNorm = 122.2427, GNorm = 0.1734, lr_0 = 9.3805e-04
Validation auc = 0.722619
Epoch 1246
Validation auc = 0.721910
Epoch 1247
Validation auc = 0.721638
Epoch 1248
Validation auc = 0.721256
Epoch 1249
Loss = 3.6426e-03, PNorm = 122.2951, GNorm = 0.0137, lr_0 = 9.3782e-04
Validation auc = 0.720874
Epoch 1250
Validation auc = 0.720057
Epoch 1251
Validation auc = 0.719348
Epoch 1252
Validation auc = 0.718530
Epoch 1253
Validation auc = 0.718421
Epoch 1254
Loss = 9.4054e-03, PNorm = 122.3199, GNorm = 0.0248, lr_0 = 9.3758e-04
Loss = 2.0477e-04, PNorm = 122.3199, GNorm = 0.0059, lr_0 = 9.3757e-04
Validation auc = 0.716677
Epoch 1255
Validation auc = 0.714605
Epoch 1256
Validation auc = 0.708826
Epoch 1257
Validation auc = 0.706100
Epoch 1258
Validation auc = 0.703320
Epoch 1259
Loss = 9.0956e-03, PNorm = 122.3269, GNorm = 0.4749, lr_0 = 9.3735e-04
Validation auc = 0.701685
Epoch 1260
Validation auc = 0.701139
Epoch 1261
Validation auc = 0.698904
Epoch 1262
Validation auc = 0.695742
Epoch 1263
Validation auc = 0.695579
Epoch 1264
Loss = 2.3616e-03, PNorm = 122.3610, GNorm = 0.0646, lr_0 = 9.3710e-04
Validation auc = 0.694979
Epoch 1265
Validation auc = 0.694815
Epoch 1266
Validation auc = 0.694161
Epoch 1267
Validation auc = 0.692308
Epoch 1268
Loss = 1.3386e-03, PNorm = 122.3895, GNorm = 0.0331, lr_0 = 9.3689e-04
Loss = 5.4182e-04, PNorm = 122.3913, GNorm = 0.0163, lr_0 = 9.3687e-04
Validation auc = 0.690182
Epoch 1269
Validation auc = 0.688928
Epoch 1270
Validation auc = 0.689146
Epoch 1271
Validation auc = 0.688982
Epoch 1272
Validation auc = 0.688819
Epoch 1273
Loss = 7.3706e-04, PNorm = 122.4258, GNorm = 0.0156, lr_0 = 9.3664e-04
Loss = 1.3318e-04, PNorm = 122.4278, GNorm = 0.0046, lr_0 = 9.3662e-04
Validation auc = 0.688982
Epoch 1274
Validation auc = 0.689146
Epoch 1275
Validation auc = 0.690182
Epoch 1276
Validation auc = 0.690509
Epoch 1277
Validation auc = 0.690781
Epoch 1278
Loss = 4.0235e-04, PNorm = 122.4464, GNorm = 0.0083, lr_0 = 9.3641e-04
Validation auc = 0.691326
Epoch 1279
Validation auc = 0.691272
Epoch 1280
Validation auc = 0.693507
Epoch 1281
Validation auc = 0.696069
Epoch 1282
Validation auc = 0.697160
Epoch 1283
Loss = 5.3407e-04, PNorm = 122.4562, GNorm = 0.0118, lr_0 = 9.3616e-04
Validation auc = 0.698250
Epoch 1284
Validation auc = 0.698850
Epoch 1285
Validation auc = 0.698850
Epoch 1286
Validation auc = 0.699231
Epoch 1287
Loss = 4.4073e-04, PNorm = 122.4647, GNorm = 0.0181, lr_0 = 9.3594e-04
Loss = 5.6203e-05, PNorm = 122.4653, GNorm = 0.0022, lr_0 = 9.3592e-04
Validation auc = 0.699177
Epoch 1288
Validation auc = 0.698686
Epoch 1289
Validation auc = 0.698141
Epoch 1290
Validation auc = 0.697923
Epoch 1291
Validation auc = 0.696887
Epoch 1292
Loss = 1.7744e-04, PNorm = 122.4740, GNorm = 0.0050, lr_0 = 9.3571e-04
Validation auc = 0.696560
Epoch 1293
Validation auc = 0.696124
Epoch 1294
Validation auc = 0.695797
Epoch 1295
Validation auc = 0.695361
Epoch 1296
Validation auc = 0.694924
Epoch 1297
Loss = 1.9216e-04, PNorm = 122.4828, GNorm = 0.0034, lr_0 = 9.3546e-04
Validation auc = 0.694379
Epoch 1298
Validation auc = 0.694216
Epoch 1299
Validation auc = 0.693289
Epoch 1300
Validation auc = 0.693289
Epoch 1301
Loss = 2.2083e-03, PNorm = 122.4863, GNorm = 0.0594, lr_0 = 9.3524e-04
Loss = 6.0766e-05, PNorm = 122.4862, GNorm = 0.0025, lr_0 = 9.3523e-04
Validation auc = 0.692417
Epoch 1302
Validation auc = 0.692035
Epoch 1303
Validation auc = 0.690454
Epoch 1304
Validation auc = 0.689582
Epoch 1305
Validation auc = 0.689037
Epoch 1306
Loss = 2.9521e-04, PNorm = 122.4900, GNorm = 0.0084, lr_0 = 9.3499e-04
Loss = 2.5733e-04, PNorm = 122.4905, GNorm = 0.0117, lr_0 = 9.3498e-04
Validation auc = 0.688710
Epoch 1307
Validation auc = 0.688328
Epoch 1308
Validation auc = 0.691381
Epoch 1309
Validation auc = 0.691490
Epoch 1310
Validation auc = 0.689255
Epoch 1311
Loss = 4.5618e-04, PNorm = 122.4919, GNorm = 0.0121, lr_0 = 9.3476e-04
Validation auc = 0.686420
Epoch 1312
Validation auc = 0.685275
Epoch 1313
Validation auc = 0.683803
Epoch 1314
Validation auc = 0.683967
Epoch 1315
Validation auc = 0.683421
Epoch 1316
Loss = 3.0671e-03, PNorm = 122.5244, GNorm = 0.2923, lr_0 = 9.3451e-04
Validation auc = 0.683149
Epoch 1317
Validation auc = 0.684512
Epoch 1318
Validation auc = 0.685657
Epoch 1319
Validation auc = 0.686038
Epoch 1320
Loss = 1.8997e-04, PNorm = 122.5296, GNorm = 0.0045, lr_0 = 9.3430e-04
Loss = 1.1162e-04, PNorm = 122.5301, GNorm = 0.0033, lr_0 = 9.3428e-04
Validation auc = 0.686911
Epoch 1321
Validation auc = 0.687510
Epoch 1322
Validation auc = 0.689909
Epoch 1323
Validation auc = 0.690727
Epoch 1324
Validation auc = 0.690890
Epoch 1325
Loss = 2.7460e-03, PNorm = 122.5287, GNorm = 0.0885, lr_0 = 9.3407e-04
Validation auc = 0.691817
Epoch 1326
Validation auc = 0.692144
Epoch 1327
Validation auc = 0.692253
Epoch 1328
Validation auc = 0.691817
Epoch 1329
Validation auc = 0.691544
Epoch 1330
Loss = 9.7264e-05, PNorm = 122.5535, GNorm = 0.0021, lr_0 = 9.3382e-04
Validation auc = 0.691544
Epoch 1331
Validation auc = 0.691326
Epoch 1332
Validation auc = 0.691272
Epoch 1333
Validation auc = 0.690999
Epoch 1334
Loss = 2.2875e-03, PNorm = 122.5650, GNorm = 0.0041, lr_0 = 9.3360e-04
Loss = 1.6450e-05, PNorm = 122.5654, GNorm = 0.0007, lr_0 = 9.3359e-04
Validation auc = 0.691054
Epoch 1335
Validation auc = 0.691817
Epoch 1336
Validation auc = 0.692798
Epoch 1337
Validation auc = 0.692962
Epoch 1338
Validation auc = 0.696287
Epoch 1339
Loss = 2.0539e-04, PNorm = 122.5700, GNorm = 0.0048, lr_0 = 9.3336e-04
Loss = 2.7578e-04, PNorm = 122.5707, GNorm = 0.0101, lr_0 = 9.3334e-04
Validation auc = 0.698741
Epoch 1340
Validation auc = 0.699449
Epoch 1341
Validation auc = 0.699667
Epoch 1342
Validation auc = 0.698195
Epoch 1343
Validation auc = 0.696942
Epoch 1344
Loss = 2.1441e-04, PNorm = 122.5859, GNorm = 0.0060, lr_0 = 9.3312e-04
Validation auc = 0.695579
Epoch 1345
Validation auc = 0.694488
Epoch 1346
Validation auc = 0.693834
Epoch 1347
Validation auc = 0.693180
Epoch 1348
Validation auc = 0.692798
Epoch 1349
Loss = 2.8682e-04, PNorm = 122.5930, GNorm = 0.0094, lr_0 = 9.3288e-04
Validation auc = 0.693180
Epoch 1350
Validation auc = 0.692798
Epoch 1351
Validation auc = 0.692199
Epoch 1352
Validation auc = 0.691981
Epoch 1353
Loss = 2.7832e-04, PNorm = 122.6046, GNorm = 0.0054, lr_0 = 9.3266e-04
Loss = 3.3919e-04, PNorm = 122.6056, GNorm = 0.0118, lr_0 = 9.3264e-04
Validation auc = 0.692362
Epoch 1354
Validation auc = 0.692417
Epoch 1355
Validation auc = 0.692689
Epoch 1356
Validation auc = 0.694325
Epoch 1357
Validation auc = 0.691817
Epoch 1358
Loss = 1.3514e-01, PNorm = 122.6357, GNorm = 4.1186, lr_0 = 9.3241e-04
Validation auc = 0.685602
Epoch 1359
Validation auc = 0.677915
Epoch 1360
Validation auc = 0.671210
Epoch 1361
Validation auc = 0.668538
Epoch 1362
Validation auc = 0.667394
Epoch 1363
Loss = 5.3961e-04, PNorm = 122.6838, GNorm = 0.0213, lr_0 = 9.3218e-04
Validation auc = 0.667339
Epoch 1364
Validation auc = 0.669792
Epoch 1365
Validation auc = 0.672191
Epoch 1366
Validation auc = 0.674372
Epoch 1367
Loss = 8.3230e-04, PNorm = 122.7124, GNorm = 0.0512, lr_0 = 9.3197e-04
Loss = 1.0660e-04, PNorm = 122.7141, GNorm = 0.0039, lr_0 = 9.3195e-04
Validation auc = 0.674971
Epoch 1368
Validation auc = 0.670719
Epoch 1369
Validation auc = 0.668647
Epoch 1370
Validation auc = 0.667503
Epoch 1371
Validation auc = 0.666957
Epoch 1372
Loss = 1.2779e-02, PNorm = 122.7316, GNorm = 0.0248, lr_0 = 9.3172e-04
Loss = 3.0396e-04, PNorm = 122.7338, GNorm = 0.0114, lr_0 = 9.3170e-04
Validation auc = 0.648422
Epoch 1373
Validation auc = 0.619419
Epoch 1374
Validation auc = 0.619037
Epoch 1375
Validation auc = 0.622581
Epoch 1376
Validation auc = 0.626015
Epoch 1377
Loss = 1.0951e-02, PNorm = 122.7878, GNorm = 0.5820, lr_0 = 9.3149e-04
Validation auc = 0.629886
Epoch 1378
Validation auc = 0.631740
Epoch 1379
Validation auc = 0.632012
Epoch 1380
Validation auc = 0.634029
Epoch 1381
Validation auc = 0.626561
Epoch 1382
Loss = 1.1144e-03, PNorm = 122.8238, GNorm = 0.0289, lr_0 = 9.3124e-04
Validation auc = 0.620073
Epoch 1383
Validation auc = 0.615766
Epoch 1384
Validation auc = 0.615712
Epoch 1385
Validation auc = 0.623453
Epoch 1386
Loss = 9.7889e-04, PNorm = 122.8702, GNorm = 0.0046, lr_0 = 9.3102e-04
Loss = 2.8010e-04, PNorm = 122.8741, GNorm = 0.0116, lr_0 = 9.3101e-04
Validation auc = 0.631740
Epoch 1387
Validation auc = 0.637137
Epoch 1388
Validation auc = 0.635937
Epoch 1389
Validation auc = 0.636319
Epoch 1390
Validation auc = 0.635774
Epoch 1391
Loss = 7.5880e-04, PNorm = 122.9436, GNorm = 0.0737, lr_0 = 9.3078e-04
Validation auc = 0.633811
Epoch 1392
Validation auc = 0.632230
Epoch 1393
Validation auc = 0.630431
Epoch 1394
Validation auc = 0.628959
Epoch 1395
Validation auc = 0.626561
Epoch 1396
Loss = 2.2701e-04, PNorm = 122.9618, GNorm = 0.0061, lr_0 = 9.3055e-04
Validation auc = 0.625525
Epoch 1397
Validation auc = 0.624489
Epoch 1398
Validation auc = 0.624434
Epoch 1399
Validation auc = 0.623889
Epoch 1400
Loss = 6.2879e-04, PNorm = 122.9718, GNorm = 0.0637, lr_0 = 9.3033e-04
Loss = 7.8961e-04, PNorm = 122.9725, GNorm = 0.0203, lr_0 = 9.3032e-04
Validation auc = 0.623399
Epoch 1401
Validation auc = 0.623017
Epoch 1402
Validation auc = 0.623071
Epoch 1403
Validation auc = 0.622962
Epoch 1404
Validation auc = 0.623235
Epoch 1405
Loss = 2.4341e-04, PNorm = 122.9821, GNorm = 0.0091, lr_0 = 9.3008e-04
Loss = 2.3560e-04, PNorm = 122.9827, GNorm = 0.0079, lr_0 = 9.3007e-04
Validation auc = 0.623290
Epoch 1406
Validation auc = 0.623453
Epoch 1407
Validation auc = 0.623399
Epoch 1408
Validation auc = 0.623235
Epoch 1409
Validation auc = 0.623508
Epoch 1410
Loss = 7.8020e-05, PNorm = 122.9886, GNorm = 0.0023, lr_0 = 9.2985e-04
Validation auc = 0.623671
Epoch 1411
Validation auc = 0.623671
Epoch 1412
Validation auc = 0.623998
Epoch 1413
Validation auc = 0.624162
Epoch 1414
Validation auc = 0.625034
Epoch 1415
Loss = 1.2437e-04, PNorm = 122.9877, GNorm = 0.0036, lr_0 = 9.2961e-04
Validation auc = 0.626288
Epoch 1416
Validation auc = 0.626888
Epoch 1417
Validation auc = 0.627378
Epoch 1418
Validation auc = 0.627705
Epoch 1419
Loss = 3.9810e-04, PNorm = 122.9929, GNorm = 0.0105, lr_0 = 9.2939e-04
Loss = 4.2379e-03, PNorm = 122.9946, GNorm = 0.1858, lr_0 = 9.2938e-04
Validation auc = 0.627978
Epoch 1420
Validation auc = 0.627269
Epoch 1421
Validation auc = 0.627378
Epoch 1422
Validation auc = 0.627705
Epoch 1423
Validation auc = 0.627978
Epoch 1424
Loss = 3.1933e-04, PNorm = 123.0168, GNorm = 0.0074, lr_0 = 9.2914e-04
Validation auc = 0.627760
Epoch 1425
Validation auc = 0.628087
Epoch 1426
Validation auc = 0.628905
Epoch 1427
Validation auc = 0.628251
Epoch 1428
Validation auc = 0.628469
Epoch 1429
Loss = 1.7172e-04, PNorm = 123.0381, GNorm = 0.0040, lr_0 = 9.2891e-04
Validation auc = 0.629014
Epoch 1430
Validation auc = 0.629014
Epoch 1431
Validation auc = 0.629832
Epoch 1432
Validation auc = 0.630268
Epoch 1433
Loss = 1.3041e-04, PNorm = 123.0509, GNorm = 0.0040, lr_0 = 9.2868e-04
Validation auc = 0.630268
Epoch 1434
Validation auc = 0.629886
Epoch 1435
Validation auc = 0.629668
Epoch 1436
Validation auc = 0.629395
Epoch 1437
Validation auc = 0.629014
Epoch 1438
Loss = 1.1088e-04, PNorm = 123.0558, GNorm = 0.0034, lr_0 = 9.2845e-04
Loss = 1.0487e-04, PNorm = 123.0561, GNorm = 0.0047, lr_0 = 9.2844e-04
Validation auc = 0.628741
Epoch 1439
Validation auc = 0.628850
Epoch 1440
Validation auc = 0.628741
Epoch 1441
Validation auc = 0.628632
Epoch 1442
Validation auc = 0.628687
Epoch 1443
Loss = 6.7332e-05, PNorm = 123.0596, GNorm = 0.0016, lr_0 = 9.2822e-04
Validation auc = 0.628632
Epoch 1444
Validation auc = 0.628796
Epoch 1445
Validation auc = 0.630867
Epoch 1446
Validation auc = 0.631140
Epoch 1447
Validation auc = 0.579458
Epoch 1448
Loss = 1.7903e-04, PNorm = 123.0654, GNorm = 0.0048, lr_0 = 9.2798e-04
Validation auc = 0.641226
Epoch 1449
Validation auc = 0.699177
Epoch 1450
Validation auc = 0.692580
Epoch 1451
Validation auc = 0.674481
Epoch 1452
Loss = 2.6333e-01, PNorm = 123.4738, GNorm = 17.6169, lr_0 = 9.2776e-04
Loss = 2.0939e+00, PNorm = 123.5430, GNorm = 10.1967, lr_0 = 9.2775e-04
Validation auc = 0.735539
Epoch 1453
Validation auc = 0.717276
Epoch 1454
Validation auc = 0.698086
Epoch 1455
Validation auc = 0.681023
Epoch 1456
Validation auc = 0.685439
Epoch 1457
Loss = 1.0028e-01, PNorm = 124.5845, GNorm = 2.0333, lr_0 = 9.2752e-04
Loss = 8.1142e-02, PNorm = 124.6470, GNorm = 2.7986, lr_0 = 9.2750e-04
Validation auc = 0.713787
Epoch 1458
Validation auc = 0.692962
Epoch 1459
Validation auc = 0.679769
Epoch 1460
Validation auc = 0.678897
Epoch 1461
Validation auc = 0.676934
Epoch 1462
Loss = 2.0459e-02, PNorm = 125.4153, GNorm = 0.4763, lr_0 = 9.2729e-04
Validation auc = 0.666903
Epoch 1463
Validation auc = 0.667175
Epoch 1464
Validation auc = 0.660143
Epoch 1465
Validation auc = 0.666358
Epoch 1466
Loss = 1.6443e-02, PNorm = 125.9738, GNorm = 0.1693, lr_0 = 9.2706e-04
Validation auc = 0.669411
Epoch 1467
Validation auc = 0.665104
Epoch 1468
Validation auc = 0.665485
Epoch 1469
Validation auc = 0.667775
Epoch 1470
Validation auc = 0.669302
Epoch 1471
Loss = 1.0440e-02, PNorm = 126.2702, GNorm = 0.1310, lr_0 = 9.2683e-04
Loss = 7.3049e-03, PNorm = 126.2842, GNorm = 0.1978, lr_0 = 9.2681e-04
Validation auc = 0.671264
Epoch 1472
Validation auc = 0.672736
Epoch 1473
Validation auc = 0.672082
Epoch 1474
Validation auc = 0.672791
Epoch 1475
Validation auc = 0.673499
Epoch 1476
Loss = 3.9606e-03, PNorm = 126.3985, GNorm = 0.1072, lr_0 = 9.2660e-04
Validation auc = 0.673009
Epoch 1477
Validation auc = 0.672191
Epoch 1478
Validation auc = 0.674208
Epoch 1479
Validation auc = 0.675953
Epoch 1480
Validation auc = 0.677697
Epoch 1481
Loss = 3.6368e-03, PNorm = 126.4700, GNorm = 0.1459, lr_0 = 9.2635e-04
Validation auc = 0.678079
Epoch 1482
Validation auc = 0.668756
Epoch 1483
Validation auc = 0.658725
Epoch 1484
Validation auc = 0.671646
Epoch 1485
Loss = 9.0638e-02, PNorm = 126.5560, GNorm = 0.5175, lr_0 = 9.2614e-04
Loss = 6.2881e-04, PNorm = 126.5660, GNorm = 0.0148, lr_0 = 9.2612e-04
Validation auc = 0.672736
Epoch 1486
Validation auc = 0.675189
Epoch 1487
Validation auc = 0.674045
Epoch 1488
Validation auc = 0.671591
Epoch 1489
Validation auc = 0.690400
Epoch 1490
Loss = 6.7620e-02, PNorm = 126.7056, GNorm = 2.0426, lr_0 = 9.2589e-04
Loss = 1.0875e+00, PNorm = 126.7496, GNorm = 17.2539, lr_0 = 9.2587e-04
Validation auc = 0.692853
Epoch 1491
Validation auc = 0.634684
Epoch 1492
Validation auc = 0.650930
Epoch 1493
Validation auc = 0.665649
Epoch 1494
Validation auc = 0.655400
Epoch 1495
Loss = 2.7017e-01, PNorm = 127.7053, GNorm = 3.5224, lr_0 = 9.2566e-04
Validation auc = 0.619092
Epoch 1496
Validation auc = 0.624325
Epoch 1497
Validation auc = 0.674099
Epoch 1498
Validation auc = 0.710026
Epoch 1499
Loss = 4.2347e-01, PNorm = 128.8239, GNorm = 5.5516, lr_0 = 9.2543e-04
Validation auc = 0.708118
Epoch 1500
Validation auc = 0.713133
Epoch 1501
Validation auc = 0.714769
Epoch 1502
Validation auc = 0.722728
Epoch 1503
Validation auc = 0.720057
Epoch 1504
Loss = 1.2044e-01, PNorm = 129.8017, GNorm = 0.9007, lr_0 = 9.2520e-04
Loss = 1.0973e-02, PNorm = 129.8649, GNorm = 0.1718, lr_0 = 9.2518e-04
Validation auc = 0.708118
Epoch 1505
Validation auc = 0.699122
Epoch 1506
Validation auc = 0.686311
Epoch 1507
Validation auc = 0.686256
Epoch 1508
Validation auc = 0.686311
Epoch 1509
Loss = 4.3679e-03, PNorm = 130.4044, GNorm = 0.0989, lr_0 = 9.2497e-04
Validation auc = 0.685439
Epoch 1510
Validation auc = 0.678133
Epoch 1511
Validation auc = 0.668211
Epoch 1512
Validation auc = 0.663577
Epoch 1513
Validation auc = 0.662105
Epoch 1514
Loss = 1.4893e-02, PNorm = 130.7061, GNorm = 0.2262, lr_0 = 9.2472e-04
Validation auc = 0.660906
Epoch 1515
Validation auc = 0.661942
Epoch 1516
Validation auc = 0.661179
Epoch 1517
Validation auc = 0.657144
Epoch 1518
Loss = 4.6024e-03, PNorm = 130.8595, GNorm = 0.0620, lr_0 = 9.2451e-04
Loss = 5.7545e-03, PNorm = 130.8686, GNorm = 0.1122, lr_0 = 9.2449e-04
Validation auc = 0.653274
Epoch 1519
Validation auc = 0.651202
Epoch 1520
Validation auc = 0.651584
Epoch 1521
Validation auc = 0.652674
Epoch 1522
Validation auc = 0.650657
Epoch 1523
Loss = 4.9914e-02, PNorm = 130.9485, GNorm = 0.9222, lr_0 = 9.2427e-04
Loss = 1.1965e-03, PNorm = 130.9530, GNorm = 0.0375, lr_0 = 9.2425e-04
Validation auc = 0.646023
Epoch 1524
Validation auc = 0.641335
Epoch 1525
Validation auc = 0.638336
Epoch 1526
Validation auc = 0.636537
Epoch 1527
Validation auc = 0.636101
Epoch 1528
Loss = 1.7922e-03, PNorm = 131.0067, GNorm = 0.0240, lr_0 = 9.2404e-04
Validation auc = 0.637682
Epoch 1529
Validation auc = 0.637791
Epoch 1530
Validation auc = 0.639208
Epoch 1531
Validation auc = 0.639426
Epoch 1532
Validation auc = 0.640571
Epoch 1533
Loss = 3.9268e-03, PNorm = 131.0486, GNorm = 0.0946, lr_0 = 9.2379e-04
Validation auc = 0.640462
Epoch 1534
Validation auc = 0.639645
Epoch 1535
Validation auc = 0.650275
Epoch 1536
Validation auc = 0.664450
Epoch 1537
Loss = 1.6094e-03, PNorm = 131.0924, GNorm = 0.0787, lr_0 = 9.2358e-04
Loss = 2.7409e-03, PNorm = 131.0965, GNorm = 0.1169, lr_0 = 9.2356e-04
Validation auc = 0.668375
Epoch 1538
Validation auc = 0.671700
Epoch 1539
Validation auc = 0.670937
Epoch 1540
Validation auc = 0.676280
Epoch 1541
Validation auc = 0.679387
Epoch 1542
Loss = 2.8688e-03, PNorm = 131.1526, GNorm = 0.0364, lr_0 = 9.2335e-04
Validation auc = 0.682331
Epoch 1543
Validation auc = 0.681895
Epoch 1544
Validation auc = 0.681132
Epoch 1545
Validation auc = 0.681350
Epoch 1546
Validation auc = 0.681622
Epoch 1547
Loss = 2.7740e-03, PNorm = 131.2406, GNorm = 0.0524, lr_0 = 9.2310e-04
Validation auc = 0.683476
Epoch 1548
Validation auc = 0.686038
Epoch 1549
Validation auc = 0.688328
Epoch 1550
Validation auc = 0.694434
Epoch 1551
Loss = 9.9567e-03, PNorm = 131.2938, GNorm = 0.2148, lr_0 = 9.2289e-04
Loss = 3.8080e-02, PNorm = 131.2999, GNorm = 1.4307, lr_0 = 9.2287e-04
Validation auc = 0.692471
Epoch 1552
Validation auc = 0.684675
Epoch 1553
Validation auc = 0.676825
Epoch 1554
Validation auc = 0.671264
Epoch 1555
Validation auc = 0.666794
Epoch 1556
Loss = 6.4110e-03, PNorm = 131.3700, GNorm = 0.4995, lr_0 = 9.2264e-04
Loss = 6.5557e-05, PNorm = 131.3734, GNorm = 0.0019, lr_0 = 9.2263e-04
Validation auc = 0.667721
Epoch 1557
Validation auc = 0.675462
Epoch 1558
Validation auc = 0.681404
Epoch 1559
Validation auc = 0.682495
Epoch 1560
Validation auc = 0.694761
Epoch 1561
Loss = 3.2247e-03, PNorm = 131.4129, GNorm = 0.0843, lr_0 = 9.2242e-04
Validation auc = 0.706918
Epoch 1562
Validation auc = 0.720002
Epoch 1563
Validation auc = 0.682113
Epoch 1564
Validation auc = 0.655891
Epoch 1565
Validation auc = 0.650930
Epoch 1566
Loss = 9.0777e-02, PNorm = 131.5914, GNorm = 0.7635, lr_0 = 9.2217e-04
Validation auc = 0.653655
Epoch 1567
Validation auc = 0.646296
Epoch 1568
Validation auc = 0.640517
Epoch 1569
Validation auc = 0.639481
Epoch 1570
Loss = 1.3170e-01, PNorm = 132.0268, GNorm = 2.9916, lr_0 = 9.2196e-04
Loss = 1.2270e-03, PNorm = 132.0508, GNorm = 0.0366, lr_0 = 9.2194e-04
Validation auc = 0.646296
Epoch 1571
Validation auc = 0.649021
Epoch 1572
Validation auc = 0.649239
Epoch 1573
Validation auc = 0.646786
Epoch 1574
Validation auc = 0.648694
Epoch 1575
Loss = 1.2737e-02, PNorm = 132.2779, GNorm = 0.3910, lr_0 = 9.2173e-04
Validation auc = 0.652729
Epoch 1576
Validation auc = 0.654419
Epoch 1577
Validation auc = 0.658671
Epoch 1578
Validation auc = 0.664068
Epoch 1579
Validation auc = 0.665485
Epoch 1580
Loss = 6.5273e-03, PNorm = 132.4407, GNorm = 0.1827, lr_0 = 9.2148e-04
Validation auc = 0.665322
Epoch 1581
Validation auc = 0.664722
Epoch 1582
Validation auc = 0.664286
Epoch 1583
Validation auc = 0.662324
Epoch 1584
Loss = 4.5037e-03, PNorm = 132.5596, GNorm = 0.0853, lr_0 = 9.2127e-04
Loss = 1.0486e-03, PNorm = 132.5684, GNorm = 0.0289, lr_0 = 9.2125e-04
Validation auc = 0.661070
Epoch 1585
Validation auc = 0.663196
Epoch 1586
Validation auc = 0.664831
Epoch 1587
Validation auc = 0.666685
Epoch 1588
Validation auc = 0.669411
Epoch 1589
Loss = 3.3318e-03, PNorm = 132.6468, GNorm = 0.1796, lr_0 = 9.2103e-04
Loss = 3.2241e-02, PNorm = 132.6528, GNorm = 1.6574, lr_0 = 9.2101e-04
Validation auc = 0.664777
Epoch 1590
Validation auc = 0.654419
Epoch 1591
Validation auc = 0.655891
Epoch 1592
Validation auc = 0.658725
Epoch 1593
Validation auc = 0.660961
Epoch 1594
Loss = 2.7921e-03, PNorm = 132.7468, GNorm = 0.0806, lr_0 = 9.2080e-04
Validation auc = 0.668211
Epoch 1595
Validation auc = 0.668811
Epoch 1596
Validation auc = 0.670501
Epoch 1597
Validation auc = 0.669629
Epoch 1598
Validation auc = 0.664559
Epoch 1599
Loss = 1.5800e-01, PNorm = 132.8855, GNorm = 1.2658, lr_0 = 9.2055e-04
Validation auc = 0.661451
Epoch 1600
Validation auc = 0.663359
Epoch 1601
Validation auc = 0.664777
Epoch 1602
Validation auc = 0.667121
Epoch 1603
Loss = 2.4635e-03, PNorm = 133.0474, GNorm = 0.0346, lr_0 = 9.2034e-04
Loss = 4.5750e-04, PNorm = 133.0554, GNorm = 0.0188, lr_0 = 9.2032e-04
Validation auc = 0.667448
Epoch 1604
Validation auc = 0.667121
Epoch 1605
Validation auc = 0.667884
Epoch 1606
Validation auc = 0.670883
Epoch 1607
Validation auc = 0.673663
Epoch 1608
Loss = 6.0529e-03, PNorm = 133.1390, GNorm = 0.0829, lr_0 = 9.2010e-04
Validation auc = 0.675462
Epoch 1609
Validation auc = 0.676498
Epoch 1610
Validation auc = 0.677152
Epoch 1611
Validation auc = 0.677752
Epoch 1612
Validation auc = 0.680805
Epoch 1613
Loss = 2.0169e-03, PNorm = 133.1920, GNorm = 0.0613, lr_0 = 9.1987e-04
Validation auc = 0.682168
Epoch 1614
Validation auc = 0.677697
Epoch 1615
Validation auc = 0.676334
Epoch 1616
Validation auc = 0.673827
Epoch 1617
Loss = 1.4979e-03, PNorm = 133.2186, GNorm = 0.0327, lr_0 = 9.1966e-04
Loss = 6.1854e-04, PNorm = 133.2210, GNorm = 0.0230, lr_0 = 9.1964e-04
Validation auc = 0.671210
Epoch 1618
Validation auc = 0.669956
Epoch 1619
Validation auc = 0.669138
Epoch 1620
Validation auc = 0.668702
Epoch 1621
Validation auc = 0.668593
Epoch 1622
Loss = 9.4181e-04, PNorm = 133.2535, GNorm = 0.0314, lr_0 = 9.1941e-04
Loss = 2.0435e-04, PNorm = 133.2556, GNorm = 0.0078, lr_0 = 9.1939e-04
Validation auc = 0.668266
Epoch 1623
Validation auc = 0.665704
Epoch 1624
Validation auc = 0.662978
Epoch 1625
Validation auc = 0.663414
Epoch 1626
Validation auc = 0.665813
Epoch 1627
Loss = 6.4657e-04, PNorm = 133.2837, GNorm = 0.0143, lr_0 = 9.1918e-04
Validation auc = 0.666957
Epoch 1628
Validation auc = 0.666031
Epoch 1629
Validation auc = 0.666739
Epoch 1630
Validation auc = 0.668647
Epoch 1631
Validation auc = 0.669738
Epoch 1632
Loss = 6.2053e-04, PNorm = 133.3089, GNorm = 0.0113, lr_0 = 9.1894e-04
Validation auc = 0.667285
Epoch 1633
Validation auc = 0.661451
Epoch 1634
Validation auc = 0.664177
Epoch 1635
Validation auc = 0.662105
Epoch 1636
Loss = 1.6899e-02, PNorm = 133.5634, GNorm = 0.3660, lr_0 = 9.1873e-04
Loss = 2.3884e-03, PNorm = 133.5960, GNorm = 0.0451, lr_0 = 9.1871e-04
Validation auc = 0.656654
Epoch 1637
Validation auc = 0.661778
Epoch 1638
Validation auc = 0.661996
Epoch 1639
Validation auc = 0.666358
Epoch 1640
Validation auc = 0.670610
Epoch 1641
Loss = 7.3793e-02, PNorm = 133.9089, GNorm = 2.6467, lr_0 = 9.1848e-04
Validation auc = 0.661942
Epoch 1642
Validation auc = 0.654364
Epoch 1643
Validation auc = 0.650439
Epoch 1644
Validation auc = 0.651257
Epoch 1645
Validation auc = 0.650820
Epoch 1646
Loss = 8.2338e-03, PNorm = 134.1317, GNorm = 0.5395, lr_0 = 9.1825e-04
Validation auc = 0.650875
Epoch 1647
Validation auc = 0.653982
Epoch 1648
Validation auc = 0.650930
Epoch 1649
Validation auc = 0.647549
Epoch 1650
Loss = 9.8984e-02, PNorm = 134.2868, GNorm = 0.8343, lr_0 = 9.1804e-04
Loss = 2.3732e-01, PNorm = 134.3041, GNorm = 6.7967, lr_0 = 9.1803e-04
Validation auc = 0.648422
Epoch 1651
Validation auc = 0.646623
Epoch 1652
Validation auc = 0.638282
Epoch 1653
Validation auc = 0.627814
Epoch 1654
Validation auc = 0.623453
Epoch 1655
Loss = 8.9518e-03, PNorm = 134.6014, GNorm = 0.1723, lr_0 = 9.1780e-04
Loss = 1.5051e-03, PNorm = 134.6213, GNorm = 0.0309, lr_0 = 9.1778e-04
Validation auc = 0.622036
Epoch 1656
Validation auc = 0.621600
Epoch 1657
Validation auc = 0.626724
Epoch 1658
Validation auc = 0.627106
Epoch 1659
Validation auc = 0.617947
Epoch 1660
Loss = 9.0045e-03, PNorm = 134.7758, GNorm = 0.2440, lr_0 = 9.1757e-04
Validation auc = 0.617456
Epoch 1661
Validation auc = 0.621927
Epoch 1662
Validation auc = 0.629286
Epoch 1663
Validation auc = 0.637791
Epoch 1664
Validation auc = 0.641171
Epoch 1665
Loss = 3.7801e-03, PNorm = 134.8971, GNorm = 0.1303, lr_0 = 9.1733e-04
Validation auc = 0.640789
Epoch 1666
Validation auc = 0.640135
Epoch 1667
Validation auc = 0.639317
Epoch 1668
Validation auc = 0.639099
Epoch 1669
Loss = 1.0038e-02, PNorm = 134.9304, GNorm = 0.0348, lr_0 = 9.1712e-04
Loss = 1.5331e-01, PNorm = 134.9283, GNorm = 7.0025, lr_0 = 9.1710e-04
Validation auc = 0.636864
Epoch 1670
Validation auc = 0.636101
Epoch 1671
Validation auc = 0.642861
Epoch 1672
Validation auc = 0.654909
Epoch 1673
Validation auc = 0.650330
Epoch 1674
Loss = 5.6220e-03, PNorm = 135.0387, GNorm = 0.1514, lr_0 = 9.1687e-04
Validation auc = 0.642207
Epoch 1675
Validation auc = 0.604290
Epoch 1676
Validation auc = 0.593687
Epoch 1677
Validation auc = 0.594069
Epoch 1678
Validation auc = 0.598157
Epoch 1679
Loss = 2.8196e-03, PNorm = 135.1211, GNorm = 0.0627, lr_0 = 9.1664e-04
Validation auc = 0.600202
Epoch 1680
Validation auc = 0.603227
Epoch 1681
Validation auc = 0.606199
Epoch 1682
Validation auc = 0.608379
Epoch 1683
Loss = 2.0205e-02, PNorm = 135.1779, GNorm = 0.0004, lr_0 = 9.1642e-04
Validation auc = 0.612850
Epoch 1684
Validation auc = 0.620100
Epoch 1685
Validation auc = 0.621463
Epoch 1686
Validation auc = 0.623971
Epoch 1687
Validation auc = 0.620755
Epoch 1688
Loss = 2.6203e-03, PNorm = 135.2308, GNorm = 0.0331, lr_0 = 9.1619e-04
Loss = 9.3803e-04, PNorm = 135.2338, GNorm = 0.0326, lr_0 = 9.1617e-04
Validation auc = 0.619501
Epoch 1689
Validation auc = 0.619310
Epoch 1690
Validation auc = 0.619773
Epoch 1691
Validation auc = 0.620618
Epoch 1692
Validation auc = 0.619800
Epoch 1693
Loss = 4.7043e-04, PNorm = 135.2862, GNorm = 0.0081, lr_0 = 9.1596e-04
Validation auc = 0.620973
Epoch 1694
Validation auc = 0.618001
Epoch 1695
Validation auc = 0.613340
Epoch 1696
Validation auc = 0.611296
Epoch 1697
Validation auc = 0.610969
Epoch 1698
Loss = 6.4965e-03, PNorm = 135.3233, GNorm = 0.1913, lr_0 = 9.1572e-04
Validation auc = 0.609361
Epoch 1699
Validation auc = 0.608161
Epoch 1700
Validation auc = 0.605899
Epoch 1701
Validation auc = 0.605626
Epoch 1702
Loss = 1.1678e-03, PNorm = 135.4003, GNorm = 0.0128, lr_0 = 9.1551e-04
Loss = 2.4206e-03, PNorm = 135.4051, GNorm = 0.0541, lr_0 = 9.1549e-04
Validation auc = 0.604072
Epoch 1703
Validation auc = 0.599166
Epoch 1704
Validation auc = 0.593796
Epoch 1705
Validation auc = 0.590988
Epoch 1706
Validation auc = 0.589271
Epoch 1707
Loss = 2.1519e-03, PNorm = 135.4407, GNorm = 0.1768, lr_0 = 9.1526e-04
Loss = 2.4429e-03, PNorm = 135.4425, GNorm = 0.0743, lr_0 = 9.1525e-04
Validation auc = 0.589080
Epoch 1708
Validation auc = 0.588590
Epoch 1709
Validation auc = 0.588317
Epoch 1710
Validation auc = 0.587554
Epoch 1711
Validation auc = 0.587908
Epoch 1712
Loss = 1.9613e-02, PNorm = 135.4560, GNorm = 0.7617, lr_0 = 9.1504e-04
Validation auc = 0.588154
Epoch 1713
Validation auc = 0.591970
Epoch 1714
Validation auc = 0.593278
Epoch 1715
Validation auc = 0.595050
Epoch 1716
Loss = 2.7669e-03, PNorm = 135.4678, GNorm = 0.0505, lr_0 = 9.1481e-04
Validation auc = 0.597667
Epoch 1717
Validation auc = 0.598812
Epoch 1718
Validation auc = 0.600229
Epoch 1719
Validation auc = 0.601265
Epoch 1720
Validation auc = 0.601919
Epoch 1721
Loss = 3.5633e-03, PNorm = 135.4909, GNorm = 0.0573, lr_0 = 9.1458e-04
Loss = 1.9853e-04, PNorm = 135.4913, GNorm = 0.0085, lr_0 = 9.1457e-04
Validation auc = 0.600529
Epoch 1722
Validation auc = 0.598512
Epoch 1723
Validation auc = 0.598239
Epoch 1724
Validation auc = 0.597830
Epoch 1725
Validation auc = 0.596849
Epoch 1726
Loss = 2.5883e-04, PNorm = 135.5086, GNorm = 0.0066, lr_0 = 9.1436e-04
Validation auc = 0.595949
Epoch 1727
Validation auc = 0.596058
Epoch 1728
Validation auc = 0.595159
Epoch 1729
Validation auc = 0.596576
Epoch 1730
Validation auc = 0.598403
Epoch 1731
Loss = 1.4129e-04, PNorm = 135.5367, GNorm = 0.0036, lr_0 = 9.1411e-04
Validation auc = 0.598866
Epoch 1732
Validation auc = 0.599793
Epoch 1733
Validation auc = 0.599875
Epoch 1734
Validation auc = 0.586027
Epoch 1735
Loss = 4.5257e-04, PNorm = 135.5598, GNorm = 0.0116, lr_0 = 9.1390e-04
Loss = 8.2614e-04, PNorm = 135.5624, GNorm = 0.0264, lr_0 = 9.1389e-04
Validation auc = 0.556398
Epoch 1736
Validation auc = 0.539198
Epoch 1737
Validation auc = 0.545058
Epoch 1738
Validation auc = 0.551546
Epoch 1739
Validation auc = 0.549474
Epoch 1740
Loss = 1.3855e-02, PNorm = 135.6304, GNorm = 0.0399, lr_0 = 9.1366e-04
Loss = 1.1829e-03, PNorm = 135.6382, GNorm = 0.0299, lr_0 = 9.1364e-04
Validation auc = 0.588126
Epoch 1741
Validation auc = 0.601946
Epoch 1742
Validation auc = 0.608625
Epoch 1743
Validation auc = 0.614103
Epoch 1744
Validation auc = 0.616502
Epoch 1745
Loss = 2.1503e-04, PNorm = 135.7082, GNorm = 0.0042, lr_0 = 9.1343e-04
Validation auc = 0.617674
Epoch 1746
Validation auc = 0.619337
Epoch 1747
Validation auc = 0.620564
Epoch 1748
Validation auc = 0.620700
Epoch 1749
Loss = 5.7257e-04, PNorm = 135.7323, GNorm = 0.0071, lr_0 = 9.1320e-04
Validation auc = 0.620509
Epoch 1750
Validation auc = 0.620046
Epoch 1751
Validation auc = 0.617293
Epoch 1752
Validation auc = 0.620427
Epoch 1753
Validation auc = 0.627487
Epoch 1754
Loss = 4.5127e-03, PNorm = 135.9764, GNorm = 0.1525, lr_0 = 9.1298e-04
Loss = 1.4446e-03, PNorm = 135.9986, GNorm = 0.0519, lr_0 = 9.1296e-04
Validation auc = 0.637791
Epoch 1755
Validation auc = 0.646514
Epoch 1756
Validation auc = 0.651475
Epoch 1757
Validation auc = 0.658289
Epoch 1758
Validation auc = 0.659543
Epoch 1759
Loss = 2.0162e-03, PNorm = 136.1662, GNorm = 0.0762, lr_0 = 9.1275e-04
Validation auc = 0.657581
Epoch 1760
Validation auc = 0.656763
Epoch 1761
Validation auc = 0.656054
Epoch 1762
Validation auc = 0.656981
Epoch 1763
Validation auc = 0.657362
Epoch 1764
Loss = 1.8889e-03, PNorm = 136.4355, GNorm = 0.0806, lr_0 = 9.1251e-04
Validation auc = 0.660852
Epoch 1765
Validation auc = 0.660306
Epoch 1766
Validation auc = 0.658616
Epoch 1767
Validation auc = 0.658180
Epoch 1768
Loss = 3.6984e-03, PNorm = 136.5079, GNorm = 0.1170, lr_0 = 9.1230e-04
Loss = 7.2584e-03, PNorm = 136.5135, GNorm = 0.3552, lr_0 = 9.1228e-04
Validation auc = 0.657417
Epoch 1769
Validation auc = 0.656654
Epoch 1770
Validation auc = 0.654746
Epoch 1771
Validation auc = 0.655236
Epoch 1772
Validation auc = 0.655345
Epoch 1773
Loss = 3.7898e-03, PNorm = 136.5764, GNorm = 0.1135, lr_0 = 9.1206e-04
Loss = 2.2284e-03, PNorm = 136.5831, GNorm = 0.0726, lr_0 = 9.1204e-04
Validation auc = 0.657035
Epoch 1774
Validation auc = 0.657635
Epoch 1775
Validation auc = 0.658834
Epoch 1776
Validation auc = 0.660306
Epoch 1777
Validation auc = 0.657362
Epoch 1778
Loss = 7.9931e-04, PNorm = 136.6235, GNorm = 0.0148, lr_0 = 9.1183e-04
Validation auc = 0.655891
Epoch 1779
Validation auc = 0.654964
Epoch 1780
Validation auc = 0.654855
Epoch 1781
Validation auc = 0.653437
Epoch 1782
Validation auc = 0.653710
Epoch 1783
Loss = 1.0218e-03, PNorm = 136.6966, GNorm = 0.0210, lr_0 = 9.1159e-04
Validation auc = 0.656490
Epoch 1784
Validation auc = 0.662269
Epoch 1785
Validation auc = 0.654800
Epoch 1786
Validation auc = 0.651802
Epoch 1787
Loss = 2.0203e-03, PNorm = 136.7440, GNorm = 0.1034, lr_0 = 9.1138e-04
Loss = 1.6974e-03, PNorm = 136.7485, GNorm = 0.0646, lr_0 = 9.1136e-04
Validation auc = 0.653110
Epoch 1788
Validation auc = 0.653982
Epoch 1789
Validation auc = 0.652510
Epoch 1790
Validation auc = 0.652456
Epoch 1791
Validation auc = 0.651747
Epoch 1792
Loss = 3.1459e-02, PNorm = 136.8320, GNorm = 1.6276, lr_0 = 9.1115e-04
Validation auc = 0.650930
Epoch 1793
Validation auc = 0.651965
Epoch 1794
Validation auc = 0.653601
Epoch 1795
Validation auc = 0.654691
Epoch 1796
Validation auc = 0.654528
Epoch 1797
Loss = 2.4409e-02, PNorm = 136.8906, GNorm = 0.9457, lr_0 = 9.1091e-04
Validation auc = 0.659652
Epoch 1798
Validation auc = 0.663032
Epoch 1799
Validation auc = 0.664559
Epoch 1800
Validation auc = 0.665867
Epoch 1801
Loss = 6.1564e-04, PNorm = 136.9034, GNorm = 0.0238, lr_0 = 9.1070e-04
Loss = 1.2964e-04, PNorm = 136.9047, GNorm = 0.0044, lr_0 = 9.1068e-04
Validation auc = 0.666249
Epoch 1802
Validation auc = 0.666685
Epoch 1803
Validation auc = 0.665267
Epoch 1804
Validation auc = 0.663468
Epoch 1805
Validation auc = 0.661615
Epoch 1806
Loss = 1.9314e-03, PNorm = 136.9182, GNorm = 0.1137, lr_0 = 9.1046e-04
Loss = 1.5787e-03, PNorm = 136.9196, GNorm = 0.1152, lr_0 = 9.1044e-04
Validation auc = 0.660361
Epoch 1807
Validation auc = 0.659816
Epoch 1808
Validation auc = 0.659707
Epoch 1809
Validation auc = 0.659870
Epoch 1810
Validation auc = 0.661342
Epoch 1811
Loss = 4.9636e-04, PNorm = 136.9447, GNorm = 0.0133, lr_0 = 9.1023e-04
Validation auc = 0.661615
Epoch 1812
Validation auc = 0.663141
Epoch 1813
Validation auc = 0.665158
Epoch 1814
Validation auc = 0.666249
Epoch 1815
Validation auc = 0.667448
Epoch 1816
Loss = 6.2651e-04, PNorm = 136.9553, GNorm = 0.0161, lr_0 = 9.0999e-04
Validation auc = 0.668157
Epoch 1817
Validation auc = 0.668429
Epoch 1818
Validation auc = 0.668975
Epoch 1819
Validation auc = 0.669629
Epoch 1820
Loss = 3.9929e-04, PNorm = 136.9726, GNorm = 0.0044, lr_0 = 9.0978e-04
Loss = 7.5096e-05, PNorm = 136.9740, GNorm = 0.0027, lr_0 = 9.0976e-04
Validation auc = 0.669901
Epoch 1821
Validation auc = 0.670337
Epoch 1822
Validation auc = 0.670828
Epoch 1823
Validation auc = 0.671319
Epoch 1824
Validation auc = 0.671973
Epoch 1825
Loss = 1.0931e-01, PNorm = 136.9925, GNorm = 0.7678, lr_0 = 9.0955e-04
Validation auc = 0.669683
Epoch 1826
Validation auc = 0.669247
Epoch 1827
Validation auc = 0.670228
Epoch 1828
Validation auc = 0.671319
Epoch 1829
Validation auc = 0.674263
Epoch 1830
Loss = 1.0689e-03, PNorm = 136.9789, GNorm = 0.0231, lr_0 = 9.0931e-04
Validation auc = 0.677588
Epoch 1831
Validation auc = 0.679714
Epoch 1832
Validation auc = 0.680805
Epoch 1833
Validation auc = 0.681459
Epoch 1834
Loss = 9.3022e-04, PNorm = 136.9994, GNorm = 0.0266, lr_0 = 9.0910e-04
Loss = 2.1360e-04, PNorm = 137.0015, GNorm = 0.0077, lr_0 = 9.0909e-04
Validation auc = 0.681459
Epoch 1835
Validation auc = 0.681786
Epoch 1836
Validation auc = 0.682440
Epoch 1837
Validation auc = 0.682222
Epoch 1838
Validation auc = 0.682549
Epoch 1839
Loss = 5.1811e-04, PNorm = 137.0256, GNorm = 0.0069, lr_0 = 9.0886e-04
Loss = 2.4340e-04, PNorm = 137.0270, GNorm = 0.0059, lr_0 = 9.0884e-04
Validation auc = 0.682549
Epoch 1840
Validation auc = 0.682767
Epoch 1841
Validation auc = 0.682931
Epoch 1842
Validation auc = 0.683094
Epoch 1843
Validation auc = 0.683858
Epoch 1844
Loss = 2.3762e-04, PNorm = 137.0376, GNorm = 0.0044, lr_0 = 9.0863e-04
Validation auc = 0.684675
Epoch 1845
Validation auc = 0.685057
Epoch 1846
Validation auc = 0.685166
Epoch 1847
Validation auc = 0.685221
Epoch 1848
Validation auc = 0.685221
Epoch 1849
Loss = 1.6375e-04, PNorm = 137.0434, GNorm = 0.0035, lr_0 = 9.0839e-04
Validation auc = 0.685221
Epoch 1850
Validation auc = 0.684893
Epoch 1851
Validation auc = 0.684948
Epoch 1852
Validation auc = 0.684457
Epoch 1853
Loss = 2.4957e-04, PNorm = 137.0482, GNorm = 0.0116, lr_0 = 9.0818e-04
Loss = 1.6848e-04, PNorm = 137.0484, GNorm = 0.0053, lr_0 = 9.0817e-04
Validation auc = 0.684948
Epoch 1854
Validation auc = 0.685275
Epoch 1855
Validation auc = 0.685384
Epoch 1856
Validation auc = 0.685330
Epoch 1857
Validation auc = 0.685111
Epoch 1858
Loss = 2.3887e-04, PNorm = 137.0537, GNorm = 0.0024, lr_0 = 9.0794e-04
Validation auc = 0.685002
Epoch 1859
Validation auc = 0.684893
Epoch 1860
Validation auc = 0.684784
Epoch 1861
Validation auc = 0.684839
Epoch 1862
Validation auc = 0.684839
Epoch 1863
Loss = 3.0547e-04, PNorm = 137.0604, GNorm = 0.0074, lr_0 = 9.0772e-04
Validation auc = 0.684784
Epoch 1864
Validation auc = 0.657526
Epoch 1865
Validation auc = 0.620019
Epoch 1866
Validation auc = 0.596685
Epoch 1867
Loss = 4.2401e-03, PNorm = 137.0708, GNorm = 0.6841, lr_0 = 9.0751e-04
Loss = 9.4023e-05, PNorm = 137.0740, GNorm = 0.0032, lr_0 = 9.0749e-04
Validation auc = 0.613695
Epoch 1868
Validation auc = 0.638173
Epoch 1869
Validation auc = 0.653001
Epoch 1870
Validation auc = 0.661724
Epoch 1871
Validation auc = 0.666685
Epoch 1872
Loss = 9.0994e-04, PNorm = 137.1069, GNorm = 0.0665, lr_0 = 9.0727e-04
Loss = 2.1060e-06, PNorm = 137.1079, GNorm = 0.0001, lr_0 = 9.0725e-04
Validation auc = 0.669411
Epoch 1873
Validation auc = 0.671264
Epoch 1874
Validation auc = 0.671864
Epoch 1875
Validation auc = 0.673172
Epoch 1876
Validation auc = 0.674481
Epoch 1877
Loss = 3.0035e-04, PNorm = 137.1140, GNorm = 0.0071, lr_0 = 9.0704e-04
Validation auc = 0.675135
Epoch 1878
Validation auc = 0.675789
Epoch 1879
Validation auc = 0.675953
Epoch 1880
Validation auc = 0.675953
Epoch 1881
Validation auc = 0.676062
Epoch 1882
Loss = 2.1687e-04, PNorm = 137.1174, GNorm = 0.0067, lr_0 = 9.0680e-04
Validation auc = 0.676225
Epoch 1883
Validation auc = 0.676116
Epoch 1884
Validation auc = 0.676225
Epoch 1885
Validation auc = 0.676116
Epoch 1886
Loss = 1.5779e-04, PNorm = 137.1212, GNorm = 0.0050, lr_0 = 9.0659e-04
Loss = 3.1857e-04, PNorm = 137.1215, GNorm = 0.0121, lr_0 = 9.0657e-04
Validation auc = 0.676225
Epoch 1887
Validation auc = 0.675953
Epoch 1888
Validation auc = 0.676171
Epoch 1889
Validation auc = 0.676389
Epoch 1890
Validation auc = 0.676225
Epoch 1891
Loss = 2.0762e-04, PNorm = 137.1253, GNorm = 0.0045, lr_0 = 9.0635e-04
Validation auc = 0.676498
Epoch 1892
Validation auc = 0.676607
Epoch 1893
Validation auc = 0.676661
Epoch 1894
Validation auc = 0.676770
Epoch 1895
Validation auc = 0.676988
Epoch 1896
Loss = 2.6906e-05, PNorm = 137.1283, GNorm = 0.0007, lr_0 = 9.0612e-04
Validation auc = 0.676988
Epoch 1897
Validation auc = 0.676988
Epoch 1898
Validation auc = 0.676934
Epoch 1899
Validation auc = 0.676770
Epoch 1900
Loss = 1.2157e-04, PNorm = 137.1310, GNorm = 0.0024, lr_0 = 9.0592e-04
Loss = 1.2251e-02, PNorm = 137.1328, GNorm = 1.4225, lr_0 = 9.0590e-04
Validation auc = 0.677043
Epoch 1901
Validation auc = 0.676770
Epoch 1902
Validation auc = 0.678188
Epoch 1903
Validation auc = 0.679987
Epoch 1904
Validation auc = 0.679823
Epoch 1905
Loss = 1.0680e-04, PNorm = 137.1391, GNorm = 0.0015, lr_0 = 9.0567e-04
Loss = 2.8270e-05, PNorm = 137.1401, GNorm = 0.0009, lr_0 = 9.0566e-04
Validation auc = 0.680259
Epoch 1906
Validation auc = 0.681077
Epoch 1907
Validation auc = 0.681350
Epoch 1908
Validation auc = 0.680750
Epoch 1909
Validation auc = 0.679278
Epoch 1910
Loss = 8.1132e-04, PNorm = 137.1468, GNorm = 0.0376, lr_0 = 9.0545e-04
Validation auc = 0.678951
Epoch 1911
Validation auc = 0.677806
Epoch 1912
Validation auc = 0.677261
Epoch 1913
Validation auc = 0.675626
Epoch 1914
Validation auc = 0.674753
Epoch 1915
Loss = 5.8428e-04, PNorm = 137.1666, GNorm = 0.0155, lr_0 = 9.0521e-04
Validation auc = 0.674644
Epoch 1916
Validation auc = 0.673936
Epoch 1917
Validation auc = 0.673336
Epoch 1918
Validation auc = 0.672954
Epoch 1919
Loss = 3.6665e-03, PNorm = 137.1948, GNorm = 0.0260, lr_0 = 9.0500e-04
Loss = 7.5152e-04, PNorm = 137.1966, GNorm = 0.0212, lr_0 = 9.0498e-04
Validation auc = 0.672682
Epoch 1920
Validation auc = 0.672409
Epoch 1921
Validation auc = 0.671918
Epoch 1922
Validation auc = 0.671809
Epoch 1923
Validation auc = 0.671591
Epoch 1924
Loss = 4.4727e-04, PNorm = 137.2189, GNorm = 0.0055, lr_0 = 9.0476e-04
Validation auc = 0.671918
Epoch 1925
Validation auc = 0.672137
Epoch 1926
Validation auc = 0.672191
Epoch 1927
Validation auc = 0.672027
Epoch 1928
Validation auc = 0.671809
Epoch 1929
Loss = 9.6559e-05, PNorm = 137.2330, GNorm = 0.0021, lr_0 = 9.0454e-04
Validation auc = 0.671646
Epoch 1930
Validation auc = 0.671646
Epoch 1931
Validation auc = 0.671373
Epoch 1932
Validation auc = 0.669847
Epoch 1933
Loss = 4.6996e-04, PNorm = 137.2406, GNorm = 0.0361, lr_0 = 9.0431e-04
Validation auc = 0.668920
Epoch 1934
Validation auc = 0.668866
Epoch 1935
Validation auc = 0.668211
Epoch 1936
Validation auc = 0.668266
Epoch 1937
Validation auc = 0.667884
Epoch 1938
Loss = 1.0289e-04, PNorm = 137.2470, GNorm = 0.0019, lr_0 = 9.0409e-04
Loss = 4.3487e-05, PNorm = 137.2473, GNorm = 0.0021, lr_0 = 9.0407e-04
Validation auc = 0.667285
Epoch 1939
Validation auc = 0.667012
Epoch 1940
Validation auc = 0.667175
Epoch 1941
Validation auc = 0.667285
Epoch 1942
Validation auc = 0.667285
Epoch 1943
Loss = 1.3889e-04, PNorm = 137.2510, GNorm = 0.0026, lr_0 = 9.0386e-04
Validation auc = 0.667339
Epoch 1944
Validation auc = 0.667230
Epoch 1945
Validation auc = 0.667339
Epoch 1946
Validation auc = 0.667339
Epoch 1947
Validation auc = 0.668702
Epoch 1948
Loss = 1.2412e-04, PNorm = 137.2527, GNorm = 0.0024, lr_0 = 9.0362e-04
Validation auc = 0.669465
Epoch 1949
Validation auc = 0.669629
Epoch 1950
Validation auc = 0.670174
Epoch 1951
Validation auc = 0.670337
Epoch 1952
Loss = 9.1759e-05, PNorm = 137.2535, GNorm = 0.0021, lr_0 = 9.0341e-04
Loss = 1.7433e-04, PNorm = 137.2537, GNorm = 0.0052, lr_0 = 9.0340e-04
Validation auc = 0.670719
Epoch 1953
Validation auc = 0.671264
Epoch 1954
Validation auc = 0.671755
Epoch 1955
Validation auc = 0.679496
Epoch 1956
Validation auc = 0.692853
Epoch 1957
Loss = 2.5810e-02, PNorm = 137.4322, GNorm = 0.0297, lr_0 = 9.0317e-04
Loss = 2.6323e-05, PNorm = 137.4530, GNorm = 0.0009, lr_0 = 9.0316e-04
Validation auc = 0.685166
Epoch 1958
Validation auc = 0.675298
Epoch 1959
Validation auc = 0.688819
Epoch 1960
Validation auc = 0.679224
Epoch 1961
Validation auc = 0.670065
Epoch 1962
Loss = 3.6691e-03, PNorm = 137.6567, GNorm = 0.1083, lr_0 = 9.0295e-04
Validation auc = 0.670719
Epoch 1963
Validation auc = 0.676443
Epoch 1964
Validation auc = 0.671319
Epoch 1965
Validation auc = 0.667830
Epoch 1966
Loss = 4.2627e-03, PNorm = 137.9169, GNorm = 0.0007, lr_0 = 9.0273e-04
Validation auc = 0.665431
Epoch 1967
Validation auc = 0.663032
Epoch 1968
Validation auc = 0.659870
Epoch 1969
Validation auc = 0.653764
Epoch 1970
Validation auc = 0.654010
Epoch 1971
Loss = 3.8615e-02, PNorm = 138.2395, GNorm = 0.8557, lr_0 = 9.0250e-04
Loss = 6.9111e-03, PNorm = 138.2662, GNorm = 0.1303, lr_0 = 9.0249e-04
Validation auc = 0.654119
Epoch 1972
Validation auc = 0.652292
Epoch 1973
Validation auc = 0.651529
Epoch 1974
Validation auc = 0.651775
Epoch 1975
Validation auc = 0.648967
Epoch 1976
Loss = 3.9916e-03, PNorm = 138.4854, GNorm = 0.1276, lr_0 = 9.0228e-04
Validation auc = 0.646650
Epoch 1977
Validation auc = 0.644687
Epoch 1978
Validation auc = 0.642861
Epoch 1979
Validation auc = 0.641498
Epoch 1980
Validation auc = 0.642098
Epoch 1981
Loss = 6.7993e-03, PNorm = 138.5663, GNorm = 0.2026, lr_0 = 9.0204e-04
Validation auc = 0.640381
Epoch 1982
Validation auc = 0.637791
Epoch 1983
Validation auc = 0.635692
Epoch 1984
Validation auc = 0.630568
Epoch 1985
Loss = 2.9762e-03, PNorm = 138.8300, GNorm = 0.0680, lr_0 = 9.0183e-04
Loss = 7.4327e-04, PNorm = 138.8490, GNorm = 0.0160, lr_0 = 9.0181e-04
Validation auc = 0.626261
Epoch 1986
Validation auc = 0.626342
Epoch 1987
Validation auc = 0.629613
Epoch 1988
Validation auc = 0.632721
Epoch 1989
Validation auc = 0.635283
Epoch 1990
Loss = 2.3031e-03, PNorm = 139.0276, GNorm = 0.0131, lr_0 = 9.0159e-04
Loss = 7.1343e-03, PNorm = 139.0336, GNorm = 0.1606, lr_0 = 9.0157e-04
Validation auc = 0.635229
Epoch 1991
Validation auc = 0.634902
Epoch 1992
Validation auc = 0.629286
Epoch 1993
Validation auc = 0.624598
Epoch 1994
Validation auc = 0.622744
Epoch 1995
Loss = 1.7501e-02, PNorm = 139.0882, GNorm = 0.4883, lr_0 = 9.0137e-04
Validation auc = 0.622608
Epoch 1996
Validation auc = 0.624734
Epoch 1997
Validation auc = 0.628523
Epoch 1998
Validation auc = 0.632312
Epoch 1999
Loss = 1.8034e-03, PNorm = 139.1358, GNorm = 0.0632, lr_0 = 9.0114e-04
Validation auc = 0.636401
Model 0 best validation auc = 0.751240 on epoch 1204
Loading pretrained parameter "encoder.encoder.0.cached_zero_vector".
Loading pretrained parameter "encoder.encoder.0.W_i.weight".
Loading pretrained parameter "encoder.encoder.0.W_h.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.bias".
Loading pretrained parameter "ffn.1.weight".
Loading pretrained parameter "ffn.1.bias".
Moving model to cuda
Model 0 test auc = 0.661611
Ensemble test auc = 0.661611
Fold 4
Splitting data with seed 4
Class sizes
sars_cov_two_active 0: 98.39%, 1: 1.61%
Total size = 3,294 | train size = 3,294 | val size = 1,096 | test size = 1,086
With class_balance, effective train size = 106
Building model 0
MoleculeModel(
  (sigmoid): Sigmoid()
  (encoder): MPN(
    (encoder): ModuleList(
      (0): MPNEncoder(
        (dropout_layer): Dropout(p=0.05, inplace=False)
        (act_func): ReLU()
        (W_i): Linear(in_features=147, out_features=2100, bias=False)
        (W_h): Linear(in_features=2100, out_features=2100, bias=False)
        (W_o): Linear(in_features=2233, out_features=2100, bias=True)
      )
    )
  )
  (ffn): Sequential(
    (0): Dropout(p=0.05, inplace=False)
    (1): Linear(in_features=2328, out_features=1, bias=True)
  )
)
Number of parameters = 9,412,429
Moving model to cuda
Epoch 0
Validation auc = 0.479038
Epoch 1
Validation auc = 0.610805
Epoch 2
Validation auc = 0.629286
Epoch 3
Validation auc = 0.540969
Epoch 4
Loss = 7.1287e-01, PNorm = 67.4097, GNorm = 1.9907, lr_0 = 2.0385e-04
Loss = 7.1434e-01, PNorm = 67.4115, GNorm = 3.7643, lr_0 = 2.1077e-04
Validation auc = 0.586545
Epoch 5
Validation auc = 0.607698
Epoch 6
Validation auc = 0.565066
Epoch 7
Validation auc = 0.626833
Epoch 8
Validation auc = 0.641825
Epoch 9
Loss = 6.6874e-01, PNorm = 67.4466, GNorm = 1.2838, lr_0 = 3.0077e-04
Validation auc = 0.626397
Epoch 10
Validation auc = 0.626670
Epoch 11
Validation auc = 0.641662
Epoch 12
Validation auc = 0.668102
Epoch 13
Validation auc = 0.594232
Epoch 14
Loss = 7.6487e-01, PNorm = 67.5119, GNorm = 5.5591, lr_0 = 4.0462e-04
Validation auc = 0.682168
Epoch 15
Validation auc = 0.644442
Epoch 16
Validation auc = 0.650820
Epoch 17
Validation auc = 0.650439
Epoch 18
Loss = 6.8624e-01, PNorm = 67.5917, GNorm = 0.9295, lr_0 = 4.9462e-04
Loss = 5.4576e-01, PNorm = 67.5991, GNorm = 1.8229, lr_0 = 5.0154e-04
Validation auc = 0.639645
Epoch 19
Validation auc = 0.625906
Epoch 20
Validation auc = 0.649185
Epoch 21
Validation auc = 0.660906
Epoch 22
Validation auc = 0.666794
Epoch 23
Loss = 6.3045e-01, PNorm = 67.7173, GNorm = 0.6970, lr_0 = 5.9846e-04
Loss = 6.9434e-01, PNorm = 67.7269, GNorm = 3.5822, lr_0 = 6.0538e-04
Validation auc = 0.675953
Epoch 24
Validation auc = 0.667775
Epoch 25
Validation auc = 0.655400
Epoch 26
Validation auc = 0.690345
Epoch 27
Validation auc = 0.659052
Epoch 28
Loss = 6.9120e-01, PNorm = 67.8891, GNorm = 1.6847, lr_0 = 6.9538e-04
Validation auc = 0.671755
Epoch 29
Validation auc = 0.671482
Epoch 30
Validation auc = 0.670556
Epoch 31
Validation auc = 0.650766
Epoch 32
Validation auc = 0.613586
Epoch 33
Loss = 5.5713e-01, PNorm = 68.1436, GNorm = 0.8650, lr_0 = 7.9923e-04
Validation auc = 0.624216
Epoch 34
Validation auc = 0.614567
Epoch 35
Validation auc = 0.553508
Epoch 36
Validation auc = 0.603282
Epoch 37
Loss = 6.2105e-01, PNorm = 68.4755, GNorm = 1.4950, lr_0 = 8.8923e-04
Loss = 6.2686e-01, PNorm = 68.5086, GNorm = 2.4612, lr_0 = 8.9615e-04
Validation auc = 0.569972
Epoch 38
Validation auc = 0.576296
Epoch 39
Validation auc = 0.597094
Epoch 40
Validation auc = 0.557106
Epoch 41
Validation auc = 0.545603
Epoch 42
Loss = 5.4486e-01, PNorm = 68.9459, GNorm = 1.2065, lr_0 = 9.8615e-04
Validation auc = 0.549692
Epoch 43
Validation auc = 0.563267
Epoch 44
Validation auc = 0.556398
Epoch 45
Validation auc = 0.573843
Epoch 46
Validation auc = 0.568718
Epoch 47
Loss = 5.6311e-01, PNorm = 69.4997, GNorm = 0.9341, lr_0 = 9.9977e-04
Validation auc = 0.592215
Epoch 48
Validation auc = 0.569154
Epoch 49
Validation auc = 0.562721
Epoch 50
Validation auc = 0.548166
Epoch 51
Loss = 5.3627e-01, PNorm = 69.9807, GNorm = 1.1956, lr_0 = 9.9954e-04
Loss = 6.4372e-01, PNorm = 70.0219, GNorm = 1.8268, lr_0 = 9.9952e-04
Validation auc = 0.546203
Epoch 52
Validation auc = 0.587254
Epoch 53
Validation auc = 0.622417
Epoch 54
Validation auc = 0.632939
Epoch 55
Validation auc = 0.634574
Epoch 56
Loss = 4.1736e-01, PNorm = 70.6507, GNorm = 1.3337, lr_0 = 9.9927e-04
Loss = 4.5825e-01, PNorm = 70.6974, GNorm = 1.7626, lr_0 = 9.9926e-04
Validation auc = 0.665431
Epoch 57
Validation auc = 0.682386
Epoch 58
Validation auc = 0.657581
Epoch 59
Validation auc = 0.583056
Epoch 60
Validation auc = 0.587472
Epoch 61
Loss = 5.1007e-01, PNorm = 71.4733, GNorm = 1.0280, lr_0 = 9.9903e-04
Validation auc = 0.607153
Epoch 62
Validation auc = 0.612822
Epoch 63
Validation auc = 0.624053
Epoch 64
Validation auc = 0.627814
Epoch 65
Validation auc = 0.643297
Epoch 66
Loss = 2.8093e-01, PNorm = 72.4580, GNorm = 1.5490, lr_0 = 9.9876e-04
Validation auc = 0.654091
Epoch 67
Validation auc = 0.635283
Epoch 68
Validation auc = 0.659925
Epoch 69
Validation auc = 0.622472
Epoch 70
Loss = 4.6599e-01, PNorm = 73.1541, GNorm = 1.1229, lr_0 = 9.9853e-04
Loss = 3.4038e-01, PNorm = 73.2131, GNorm = 5.1709, lr_0 = 9.9851e-04
Validation auc = 0.620182
Epoch 71
Validation auc = 0.671101
Epoch 72
Validation auc = 0.609497
Epoch 73
Validation auc = 0.610751
Epoch 74
Validation auc = 0.578150
Epoch 75
Loss = 6.4350e-01, PNorm = 74.0553, GNorm = 2.3309, lr_0 = 9.9828e-04
Validation auc = 0.594723
Epoch 76
Validation auc = 0.600393
Epoch 77
Validation auc = 0.597885
Epoch 78
Validation auc = 0.620673
Epoch 79
Validation auc = 0.624816
Epoch 80
Loss = 5.2627e-01, PNorm = 75.0175, GNorm = 0.8086, lr_0 = 9.9802e-04
Validation auc = 0.623944
Epoch 81
Validation auc = 0.615984
Epoch 82
Validation auc = 0.647113
Epoch 83
Validation auc = 0.652620
Epoch 84
Loss = 4.7470e-01, PNorm = 75.4804, GNorm = 0.9477, lr_0 = 9.9779e-04
Loss = 8.3227e-01, PNorm = 75.5039, GNorm = 5.9437, lr_0 = 9.9777e-04
Validation auc = 0.653601
Epoch 85
Validation auc = 0.646296
Epoch 86
Validation auc = 0.638990
Epoch 87
Validation auc = 0.627705
Epoch 88
Validation auc = 0.630649
Epoch 89
Loss = 4.2254e-01, PNorm = 75.9183, GNorm = 0.7230, lr_0 = 9.9752e-04
Loss = 6.5201e-01, PNorm = 75.9474, GNorm = 2.9909, lr_0 = 9.9750e-04
Validation auc = 0.622472
Epoch 90
Validation auc = 0.641553
Epoch 91
Validation auc = 0.652347
Epoch 92
Validation auc = 0.640735
Epoch 93
Validation auc = 0.626397
Epoch 94
Loss = 2.5509e-01, PNorm = 76.4226, GNorm = 0.6213, lr_0 = 9.9727e-04
Validation auc = 0.596740
Epoch 95
Validation auc = 0.569754
Epoch 96
Validation auc = 0.601864
Epoch 97
Validation auc = 0.623017
Epoch 98
Validation auc = 0.645805
Epoch 99
Loss = 2.3958e-01, PNorm = 77.0222, GNorm = 0.6026, lr_0 = 9.9701e-04
Validation auc = 0.643733
Epoch 100
Validation auc = 0.629777
Epoch 101
Validation auc = 0.627760
Epoch 102
Validation auc = 0.623399
Epoch 103
Loss = 2.6552e-01, PNorm = 77.5754, GNorm = 1.5111, lr_0 = 9.9678e-04
Loss = 8.6241e-01, PNorm = 77.6224, GNorm = 4.5820, lr_0 = 9.9676e-04
Validation auc = 0.599411
Epoch 104
Validation auc = 0.569209
Epoch 105
Validation auc = 0.611241
Epoch 106
Validation auc = 0.599248
Epoch 107
Validation auc = 0.583056
Epoch 108
Loss = 1.8977e-01, PNorm = 78.3746, GNorm = 0.5569, lr_0 = 9.9651e-04
Validation auc = 0.585564
Epoch 109
Validation auc = 0.594178
Epoch 110
Validation auc = 0.584583
Epoch 111
Validation auc = 0.588453
Epoch 112
Validation auc = 0.593578
Epoch 113
Loss = 2.5749e-01, PNorm = 79.0206, GNorm = 0.9055, lr_0 = 9.9627e-04
Validation auc = 0.600229
Epoch 114
Validation auc = 0.608243
Epoch 115
Validation auc = 0.615112
Epoch 116
Validation auc = 0.628632
Epoch 117
Loss = 1.4552e-01, PNorm = 79.5551, GNorm = 0.6645, lr_0 = 9.9604e-04
Loss = 1.0383e-01, PNorm = 79.5952, GNorm = 0.9830, lr_0 = 9.9602e-04
Validation auc = 0.623944
Epoch 118
Validation auc = 0.584147
Epoch 119
Validation auc = 0.582838
Epoch 120
Validation auc = 0.563866
Epoch 121
Validation auc = 0.586164
Epoch 122
Loss = 1.1277e-01, PNorm = 80.0584, GNorm = 1.4509, lr_0 = 9.9577e-04
Loss = 1.6872e-01, PNorm = 80.0857, GNorm = 2.3868, lr_0 = 9.9575e-04
Validation auc = 0.594614
Epoch 123
Validation auc = 0.594559
Epoch 124
Validation auc = 0.575478
Epoch 125
Validation auc = 0.554708
Epoch 126
Validation auc = 0.549038
Epoch 127
Loss = 2.3098e-01, PNorm = 80.5681, GNorm = 1.2025, lr_0 = 9.9552e-04
Validation auc = 0.570899
Epoch 128
Validation auc = 0.560595
Epoch 129
Validation auc = 0.563212
Epoch 130
Validation auc = 0.561904
Epoch 131
Validation auc = 0.594341
Epoch 132
Loss = 1.4869e-01, PNorm = 81.1501, GNorm = 1.4228, lr_0 = 9.9526e-04
Validation auc = 0.620400
Epoch 133
Validation auc = 0.626397
Epoch 134
Validation auc = 0.619473
Epoch 135
Validation auc = 0.614894
Epoch 136
Loss = 1.5324e-01, PNorm = 81.6372, GNorm = 1.0105, lr_0 = 9.9503e-04
Loss = 2.1984e-02, PNorm = 81.6728, GNorm = 0.3731, lr_0 = 9.9501e-04
Validation auc = 0.628578
Epoch 137
Validation auc = 0.626724
Epoch 138
Validation auc = 0.617184
Epoch 139
Validation auc = 0.617565
Epoch 140
Validation auc = 0.616911
Epoch 141
Loss = 9.3352e-02, PNorm = 82.0778, GNorm = 1.0087, lr_0 = 9.9477e-04
Validation auc = 0.608461
Epoch 142
Validation auc = 0.612713
Epoch 143
Validation auc = 0.613040
Epoch 144
Validation auc = 0.609933
Epoch 145
Validation auc = 0.606662
Epoch 146
Loss = 5.7501e-02, PNorm = 82.4334, GNorm = 0.6029, lr_0 = 9.9452e-04
Validation auc = 0.602192
Epoch 147
Validation auc = 0.599248
Epoch 148
Validation auc = 0.601483
Epoch 149
Validation auc = 0.609660
Epoch 150
Loss = 6.2077e-02, PNorm = 82.7152, GNorm = 0.4439, lr_0 = 9.9429e-04
Loss = 3.3512e-02, PNorm = 82.7444, GNorm = 0.7411, lr_0 = 9.9427e-04
Validation auc = 0.624325
Epoch 151
Validation auc = 0.645423
Epoch 152
Validation auc = 0.651747
Epoch 153
Validation auc = 0.637573
Epoch 154
Validation auc = 0.602083
Epoch 155
Loss = 1.5875e-01, PNorm = 83.0772, GNorm = 1.6267, lr_0 = 9.9403e-04
Loss = 5.3735e-03, PNorm = 83.0982, GNorm = 0.1212, lr_0 = 9.9401e-04
Validation auc = 0.583656
Epoch 156
Validation auc = 0.568010
Epoch 157
Validation auc = 0.557542
Epoch 158
Validation auc = 0.538843
Epoch 159
Validation auc = 0.527722
Epoch 160
Loss = 8.0955e-02, PNorm = 83.3585, GNorm = 0.5771, lr_0 = 9.9378e-04
Validation auc = 0.533991
Epoch 161
Validation auc = 0.533610
Epoch 162
Validation auc = 0.547021
Epoch 163
Validation auc = 0.556997
Epoch 164
Validation auc = 0.554871
Epoch 165
Loss = 5.7323e-02, PNorm = 83.6079, GNorm = 0.7248, lr_0 = 9.9351e-04
Validation auc = 0.569209
Epoch 166
Validation auc = 0.561740
Epoch 167
Validation auc = 0.548002
Epoch 168
Validation auc = 0.540315
Epoch 169
Loss = 5.5167e-02, PNorm = 83.8572, GNorm = 0.4393, lr_0 = 9.9329e-04
Loss = 1.9769e-02, PNorm = 83.8807, GNorm = 0.4765, lr_0 = 9.9327e-04
Validation auc = 0.530775
Epoch 170
Validation auc = 0.531701
Epoch 171
Validation auc = 0.540806
Epoch 172
Validation auc = 0.547457
Epoch 173
Validation auc = 0.551437
Epoch 174
Loss = 1.6936e-02, PNorm = 84.1537, GNorm = 0.2804, lr_0 = 9.9302e-04
Validation auc = 0.554435
Epoch 175
Validation auc = 0.554326
Epoch 176
Validation auc = 0.559069
Epoch 177
Validation auc = 0.561468
Epoch 178
Validation auc = 0.565338
Epoch 179
Loss = 1.6776e-02, PNorm = 84.3217, GNorm = 0.2831, lr_0 = 9.9277e-04
Validation auc = 0.564193
Epoch 180
Validation auc = 0.559832
Epoch 181
Validation auc = 0.560105
Epoch 182
Validation auc = 0.559778
Epoch 183
Loss = 3.1695e-02, PNorm = 84.4788, GNorm = 0.2108, lr_0 = 9.9253e-04
Validation auc = 0.559723
Epoch 184
Validation auc = 0.563648
Epoch 185
Validation auc = 0.555798
Epoch 186
Validation auc = 0.534100
Epoch 187
Validation auc = 0.521834
Epoch 188
Loss = 6.2969e-02, PNorm = 84.6509, GNorm = 0.3360, lr_0 = 9.9228e-04
Loss = 7.8825e-02, PNorm = 84.6652, GNorm = 2.5566, lr_0 = 9.9226e-04
Validation auc = 0.530175
Epoch 189
Validation auc = 0.538625
Epoch 190
Validation auc = 0.512784
Epoch 191
Validation auc = 0.570953
Epoch 192
Validation auc = 0.590525
Epoch 193
Loss = 3.2561e-03, PNorm = 84.8905, GNorm = 0.0710, lr_0 = 9.9204e-04
Validation auc = 0.593960
Epoch 194
Validation auc = 0.610914
Epoch 195
Validation auc = 0.607207
Epoch 196
Validation auc = 0.602301
Epoch 197
Validation auc = 0.587854
Epoch 198
Loss = 3.7682e-02, PNorm = 85.2042, GNorm = 0.4386, lr_0 = 9.9177e-04
Validation auc = 0.580603
Epoch 199
Validation auc = 0.595050
Epoch 200
Validation auc = 0.602900
Epoch 201
Validation auc = 0.602083
Epoch 202
Loss = 1.0217e-01, PNorm = 85.4561, GNorm = 1.3878, lr_0 = 9.9154e-04
Loss = 3.5131e-02, PNorm = 85.4701, GNorm = 1.8069, lr_0 = 9.9153e-04
Validation auc = 0.602900
Epoch 203
Validation auc = 0.611187
Epoch 204
Validation auc = 0.613531
Epoch 205
Validation auc = 0.611568
Epoch 206
Validation auc = 0.612277
Epoch 207
Loss = 2.5815e-02, PNorm = 85.6906, GNorm = 0.5017, lr_0 = 9.9128e-04
Loss = 1.1262e-02, PNorm = 85.7058, GNorm = 0.2422, lr_0 = 9.9126e-04
Validation auc = 0.614730
Epoch 208
Validation auc = 0.612386
Epoch 209
Validation auc = 0.614458
Epoch 210
Validation auc = 0.610369
Epoch 211
Validation auc = 0.602137
Epoch 212
Loss = 1.8447e-01, PNorm = 85.8556, GNorm = 0.8886, lr_0 = 9.9103e-04
Validation auc = 0.597067
Epoch 213
Validation auc = 0.592160
Epoch 214
Validation auc = 0.588181
Epoch 215
Validation auc = 0.589544
Epoch 216
Loss = 4.6149e-02, PNorm = 85.9756, GNorm = 3.5468, lr_0 = 9.9079e-04
Validation auc = 0.593033
Epoch 217
Validation auc = 0.587363
Epoch 218
Validation auc = 0.567301
Epoch 219
Validation auc = 0.603282
Epoch 220
Validation auc = 0.582184
Epoch 221
Loss = 1.9318e-01, PNorm = 86.2878, GNorm = 2.3814, lr_0 = 9.9054e-04
Loss = 4.3582e-02, PNorm = 86.3239, GNorm = 0.9334, lr_0 = 9.9052e-04
Validation auc = 0.557161
Epoch 222
Validation auc = 0.555035
Epoch 223
Validation auc = 0.543641
Epoch 224
Validation auc = 0.548329
Epoch 225
Validation auc = 0.522652
Epoch 226
Loss = 2.1558e-01, PNorm = 86.8867, GNorm = 2.1802, lr_0 = 9.9030e-04
Validation auc = 0.501009
Epoch 227
Validation auc = 0.513820
Epoch 228
Validation auc = 0.538134
Epoch 229
Validation auc = 0.552908
Epoch 230
Validation auc = 0.567846
Epoch 231
Loss = 1.1238e-01, PNorm = 87.4753, GNorm = 0.9168, lr_0 = 9.9003e-04
Validation auc = 0.584801
Epoch 232
Validation auc = 0.597612
Epoch 233
Validation auc = 0.589489
Epoch 234
Validation auc = 0.579349
Epoch 235
Loss = 9.1991e-02, PNorm = 87.8964, GNorm = 1.2473, lr_0 = 9.8980e-04
Loss = 2.0471e-02, PNorm = 87.9216, GNorm = 0.6750, lr_0 = 9.8979e-04
Validation auc = 0.574661
Epoch 236
Validation auc = 0.573134
Epoch 237
Validation auc = 0.558197
Epoch 238
Validation auc = 0.553508
Epoch 239
Validation auc = 0.557215
Epoch 240
Loss = 6.4453e-02, PNorm = 88.1950, GNorm = 0.2636, lr_0 = 9.8954e-04
Loss = 3.6690e-03, PNorm = 88.2129, GNorm = 0.1153, lr_0 = 9.8952e-04
Validation auc = 0.563648
Epoch 241
Validation auc = 0.570354
Epoch 242
Validation auc = 0.572916
Epoch 243
Validation auc = 0.585946
Epoch 244
Validation auc = 0.591561
Epoch 245
Loss = 1.9034e-01, PNorm = 88.4244, GNorm = 1.6609, lr_0 = 9.8930e-04
Validation auc = 0.597721
Epoch 246
Validation auc = 0.601047
Epoch 247
Validation auc = 0.600938
Epoch 248
Validation auc = 0.599738
Epoch 249
Loss = 5.0737e-03, PNorm = 88.5624, GNorm = 0.0859, lr_0 = 9.8905e-04
Validation auc = 0.598757
Epoch 250
Validation auc = 0.598157
Epoch 251
Validation auc = 0.609388
Epoch 252
Validation auc = 0.617020
Epoch 253
Validation auc = 0.621927
Epoch 254
Loss = 5.6588e-02, PNorm = 88.6158, GNorm = 2.5480, lr_0 = 9.8880e-04
Loss = 3.9561e-03, PNorm = 88.6193, GNorm = 0.0745, lr_0 = 9.8879e-04
Validation auc = 0.616311
Epoch 255
Validation auc = 0.608079
Epoch 256
Validation auc = 0.605190
Epoch 257
Validation auc = 0.597067
Epoch 258
Validation auc = 0.592051
Epoch 259
Loss = 1.0530e-02, PNorm = 88.6936, GNorm = 0.1797, lr_0 = 9.8856e-04
Validation auc = 0.590961
Epoch 260
Validation auc = 0.594886
Epoch 261
Validation auc = 0.600174
Epoch 262
Validation auc = 0.605953
Epoch 263
Validation auc = 0.619473
Epoch 264
Loss = 5.9589e-03, PNorm = 88.7871, GNorm = 0.1188, lr_0 = 9.8830e-04
Validation auc = 0.622199
Epoch 265
Validation auc = 0.611241
Epoch 266
Validation auc = 0.604427
Epoch 267
Validation auc = 0.600556
Epoch 268
Loss = 7.3037e-02, PNorm = 88.8558, GNorm = 1.6340, lr_0 = 9.8807e-04
Loss = 8.6689e-04, PNorm = 88.8601, GNorm = 0.0239, lr_0 = 9.8805e-04
Validation auc = 0.605626
Epoch 269
Validation auc = 0.606989
Epoch 270
Validation auc = 0.606498
Epoch 271
Validation auc = 0.605844
Epoch 272
Validation auc = 0.603609
Epoch 273
Loss = 5.8708e-02, PNorm = 88.9298, GNorm = 0.0403, lr_0 = 9.8781e-04
Loss = 4.6344e-03, PNorm = 88.9343, GNorm = 0.1536, lr_0 = 9.8779e-04
Validation auc = 0.606117
Epoch 274
Validation auc = 0.609061
Epoch 275
Validation auc = 0.609987
Epoch 276
Validation auc = 0.609333
Epoch 277
Validation auc = 0.608406
Epoch 278
Loss = 3.9894e-03, PNorm = 88.9904, GNorm = 0.0585, lr_0 = 9.8756e-04
Validation auc = 0.609497
Epoch 279
Validation auc = 0.612931
Epoch 280
Validation auc = 0.617184
Epoch 281
Validation auc = 0.619855
Epoch 282
Validation auc = 0.621109
Epoch 283
Loss = 9.1992e-03, PNorm = 89.0540, GNorm = 0.1378, lr_0 = 9.8730e-04
Validation auc = 0.621272
Epoch 284
Validation auc = 0.622744
Epoch 285
Validation auc = 0.620564
Epoch 286
Validation auc = 0.621327
Epoch 287
Loss = 1.7959e-02, PNorm = 89.1248, GNorm = 1.5159, lr_0 = 9.8707e-04
Loss = 2.0289e-02, PNorm = 89.1337, GNorm = 0.9230, lr_0 = 9.8705e-04
Validation auc = 0.615494
Epoch 288
Validation auc = 0.611568
Epoch 289
Validation auc = 0.610969
Epoch 290
Validation auc = 0.610969
Epoch 291
Validation auc = 0.609497
Epoch 292
Loss = 1.0058e-02, PNorm = 89.2764, GNorm = 0.3260, lr_0 = 9.8683e-04
Validation auc = 0.607752
Epoch 293
Validation auc = 0.605681
Epoch 294
Validation auc = 0.597830
Epoch 295
Validation auc = 0.602137
Epoch 296
Validation auc = 0.606008
Epoch 297
Loss = 1.7432e-02, PNorm = 89.3760, GNorm = 0.3122, lr_0 = 9.8656e-04
Validation auc = 0.606553
Epoch 298
Validation auc = 0.604972
Epoch 299
Validation auc = 0.602519
Epoch 300
Validation auc = 0.600065
Epoch 301
Loss = 6.2139e-03, PNorm = 89.4436, GNorm = 0.0337, lr_0 = 9.8634e-04
Loss = 7.6247e-04, PNorm = 89.4478, GNorm = 0.0206, lr_0 = 9.8632e-04
Validation auc = 0.598757
Epoch 302
Validation auc = 0.597285
Epoch 303
Validation auc = 0.595813
Epoch 304
Validation auc = 0.599357
Epoch 305
Validation auc = 0.601319
Epoch 306
Loss = 1.3234e-02, PNorm = 89.4956, GNorm = 0.2370, lr_0 = 9.8607e-04
Loss = 4.4421e-03, PNorm = 89.5014, GNorm = 0.1403, lr_0 = 9.8606e-04
Validation auc = 0.601156
Epoch 307
Validation auc = 0.595949
Epoch 308
Validation auc = 0.590743
Epoch 309
Validation auc = 0.588017
Epoch 310
Validation auc = 0.587090
Epoch 311
Loss = 6.7434e-04, PNorm = 89.5710, GNorm = 0.0124, lr_0 = 9.8583e-04
Validation auc = 0.588072
Epoch 312
Validation auc = 0.589380
Epoch 313
Validation auc = 0.589108
Epoch 314
Validation auc = 0.585073
Epoch 315
Validation auc = 0.578477
Epoch 316
Loss = 2.6086e-03, PNorm = 89.6172, GNorm = 0.1149, lr_0 = 9.8557e-04
Validation auc = 0.576024
Epoch 317
Validation auc = 0.573625
Epoch 318
Validation auc = 0.573734
Epoch 319
Validation auc = 0.574770
Epoch 320
Loss = 2.1910e-02, PNorm = 89.6741, GNorm = 0.1516, lr_0 = 9.8534e-04
Loss = 7.9859e-04, PNorm = 89.6789, GNorm = 0.0307, lr_0 = 9.8532e-04
Validation auc = 0.580385
Epoch 321
Validation auc = 0.582075
Epoch 322
Validation auc = 0.580821
Epoch 323
Validation auc = 0.579676
Epoch 324
Validation auc = 0.578804
Epoch 325
Loss = 8.1121e-04, PNorm = 89.7268, GNorm = 0.0140, lr_0 = 9.8509e-04
Validation auc = 0.578804
Epoch 326
Validation auc = 0.586327
Epoch 327
Validation auc = 0.592215
Epoch 328
Validation auc = 0.593523
Epoch 329
Validation auc = 0.595050
Epoch 330
Loss = 1.2224e-01, PNorm = 89.7657, GNorm = 0.5530, lr_0 = 9.8483e-04
Validation auc = 0.596358
Epoch 331
Validation auc = 0.598539
Epoch 332
Validation auc = 0.600665
Epoch 333
Validation auc = 0.602519
Epoch 334
Loss = 8.5711e-04, PNorm = 89.8218, GNorm = 0.0274, lr_0 = 9.8461e-04
Loss = 2.7465e-04, PNorm = 89.8251, GNorm = 0.0080, lr_0 = 9.8459e-04
Validation auc = 0.603445
Epoch 335
Validation auc = 0.604100
Epoch 336
Validation auc = 0.604972
Epoch 337
Validation auc = 0.606062
Epoch 338
Validation auc = 0.605844
Epoch 339
Loss = 3.7743e-03, PNorm = 89.8543, GNorm = 0.2379, lr_0 = 9.8434e-04
Loss = 9.7290e-01, PNorm = 89.8523, GNorm = 5.5100, lr_0 = 9.8433e-04
Validation auc = 0.607534
Epoch 340
Validation auc = 0.613531
Epoch 341
Validation auc = 0.610533
Epoch 342
Validation auc = 0.599302
Epoch 343
Validation auc = 0.605463
Epoch 344
Loss = 6.1432e-02, PNorm = 90.0305, GNorm = 1.6937, lr_0 = 9.8410e-04
Validation auc = 0.604481
Epoch 345
Validation auc = 0.604917
Epoch 346
Validation auc = 0.611296
Epoch 347
Validation auc = 0.614676
Epoch 348
Validation auc = 0.616966
Epoch 349
Loss = 5.1869e-02, PNorm = 90.3708, GNorm = 0.4768, lr_0 = 9.8384e-04
Validation auc = 0.613531
Epoch 350
Validation auc = 0.615385
Epoch 351
Validation auc = 0.615276
Epoch 352
Validation auc = 0.615875
Epoch 353
Loss = 7.6216e-03, PNorm = 90.5500, GNorm = 0.1241, lr_0 = 9.8361e-04
Loss = 1.5328e-03, PNorm = 90.5599, GNorm = 0.0502, lr_0 = 9.8359e-04
Validation auc = 0.616039
Epoch 354
Validation auc = 0.616802
Epoch 355
Validation auc = 0.618110
Epoch 356
Validation auc = 0.621545
Epoch 357
Validation auc = 0.624980
Epoch 358
Loss = 7.2918e-03, PNorm = 90.6429, GNorm = 0.1112, lr_0 = 9.8335e-04
Validation auc = 0.629232
Epoch 359
Validation auc = 0.630976
Epoch 360
Validation auc = 0.632394
Epoch 361
Validation auc = 0.637300
Epoch 362
Validation auc = 0.640353
Epoch 363
Loss = 2.4872e-02, PNorm = 90.7011, GNorm = 0.5350, lr_0 = 9.8311e-04
Validation auc = 0.639590
Epoch 364
Validation auc = 0.636973
Epoch 365
Validation auc = 0.639099
Epoch 366
Validation auc = 0.638936
Epoch 367
Loss = 7.6524e-03, PNorm = 90.7419, GNorm = 0.5114, lr_0 = 9.8288e-04
Loss = 3.0740e-03, PNorm = 90.7452, GNorm = 0.0974, lr_0 = 9.8286e-04
Validation auc = 0.635556
Epoch 368
Validation auc = 0.628796
Epoch 369
Validation auc = 0.625143
Epoch 370
Validation auc = 0.622799
Epoch 371
Validation auc = 0.621600
Epoch 372
Loss = 7.8189e-02, PNorm = 90.7820, GNorm = 1.1693, lr_0 = 9.8262e-04
Loss = 6.6025e-04, PNorm = 90.7857, GNorm = 0.0199, lr_0 = 9.8260e-04
Validation auc = 0.616966
Epoch 373
Validation auc = 0.609115
Epoch 374
Validation auc = 0.616638
Epoch 375
Validation auc = 0.620945
Epoch 376
Validation auc = 0.624543
Epoch 377
Loss = 7.6848e-03, PNorm = 90.8598, GNorm = 0.1624, lr_0 = 9.8237e-04
Validation auc = 0.626615
Epoch 378
Validation auc = 0.627051
Epoch 379
Validation auc = 0.626015
Epoch 380
Validation auc = 0.626561
Epoch 381
Validation auc = 0.624761
Epoch 382
Loss = 1.0666e-02, PNorm = 90.9845, GNorm = 0.2497, lr_0 = 9.8211e-04
Validation auc = 0.623562
Epoch 383
Validation auc = 0.619637
Epoch 384
Validation auc = 0.617456
Epoch 385
Validation auc = 0.618710
Epoch 386
Loss = 2.1166e-02, PNorm = 91.1298, GNorm = 0.6858, lr_0 = 9.8189e-04
Loss = 1.9457e-04, PNorm = 91.1398, GNorm = 0.0057, lr_0 = 9.8187e-04
Validation auc = 0.616420
Epoch 387
Validation auc = 0.608734
Epoch 388
Validation auc = 0.606335
Epoch 389
Validation auc = 0.597721
Epoch 390
Validation auc = 0.612059
Epoch 391
Loss = 1.1569e-01, PNorm = 91.3102, GNorm = 2.7515, lr_0 = 9.8163e-04
Validation auc = 0.623780
Epoch 392
Validation auc = 0.682822
Epoch 393
Validation auc = 0.698523
Epoch 394
Validation auc = 0.689418
Epoch 395
Validation auc = 0.665922
Epoch 396
Loss = 1.3766e-02, PNorm = 92.3662, GNorm = 0.1823, lr_0 = 9.8138e-04
Validation auc = 0.650384
Epoch 397
Validation auc = 0.648040
Epoch 398
Validation auc = 0.645859
Epoch 399
Validation auc = 0.648258
Epoch 400
Loss = 3.7948e-02, PNorm = 92.9792, GNorm = 0.2669, lr_0 = 9.8116e-04
Loss = 2.8971e-02, PNorm = 93.0094, GNorm = 1.8416, lr_0 = 9.8114e-04
Validation auc = 0.619255
Epoch 401
Validation auc = 0.591561
Epoch 402
Validation auc = 0.586491
Epoch 403
Validation auc = 0.587036
Epoch 404
Validation auc = 0.584910
Epoch 405
Loss = 4.7940e-02, PNorm = 93.3317, GNorm = 1.5273, lr_0 = 9.8089e-04
Loss = 5.3197e-03, PNorm = 93.3459, GNorm = 0.2640, lr_0 = 9.8088e-04
Validation auc = 0.566047
Epoch 406
Validation auc = 0.576078
Epoch 407
Validation auc = 0.580767
Epoch 408
Validation auc = 0.559941
Epoch 409
Validation auc = 0.543968
Epoch 410
Loss = 5.0743e-02, PNorm = 93.5518, GNorm = 1.3416, lr_0 = 9.8065e-04
Validation auc = 0.591016
Epoch 411
Validation auc = 0.610206
Epoch 412
Validation auc = 0.612604
Epoch 413
Validation auc = 0.610696
Epoch 414
Validation auc = 0.611187
Epoch 415
Loss = 7.5373e-03, PNorm = 93.7424, GNorm = 0.1010, lr_0 = 9.8039e-04
Validation auc = 0.615875
Epoch 416
Validation auc = 0.620836
Epoch 417
Validation auc = 0.622090
Epoch 418
Validation auc = 0.621545
Epoch 419
Loss = 4.3190e-02, PNorm = 93.8633, GNorm = 0.0667, lr_0 = 9.8016e-04
Loss = 2.7754e-03, PNorm = 93.8702, GNorm = 0.0791, lr_0 = 9.8015e-04
Validation auc = 0.624925
Epoch 420
Validation auc = 0.629177
Epoch 421
Validation auc = 0.627923
Epoch 422
Validation auc = 0.627705
Epoch 423
Validation auc = 0.633103
Epoch 424
Loss = 1.9590e-02, PNorm = 93.9597, GNorm = 0.7789, lr_0 = 9.7990e-04
Validation auc = 0.623780
Epoch 425
Validation auc = 0.617729
Epoch 426
Validation auc = 0.612386
Epoch 427
Validation auc = 0.609279
Epoch 428
Validation auc = 0.609497
Epoch 429
Loss = 1.6242e-03, PNorm = 94.0267, GNorm = 0.0585, lr_0 = 9.7966e-04
Validation auc = 0.610096
Epoch 430
Validation auc = 0.611459
Epoch 431
Validation auc = 0.613749
Epoch 432
Validation auc = 0.615003
Epoch 433
Loss = 3.4895e-02, PNorm = 94.1071, GNorm = 0.0405, lr_0 = 9.7942e-04
Validation auc = 0.611623
Epoch 434
Validation auc = 0.607044
Epoch 435
Validation auc = 0.600338
Epoch 436
Validation auc = 0.598484
Epoch 437
Validation auc = 0.593360
Epoch 438
Loss = 3.7248e-02, PNorm = 94.2374, GNorm = 2.4793, lr_0 = 9.7917e-04
Loss = 2.6540e-03, PNorm = 94.2531, GNorm = 0.0909, lr_0 = 9.7916e-04
Validation auc = 0.597776
Epoch 439
Validation auc = 0.610478
Epoch 440
Validation auc = 0.644115
Epoch 441
Validation auc = 0.637518
Epoch 442
Validation auc = 0.622472
Epoch 443
Loss = 1.4176e-01, PNorm = 94.6546, GNorm = 1.8953, lr_0 = 9.7893e-04
Validation auc = 0.615058
Epoch 444
Validation auc = 0.612441
Epoch 445
Validation auc = 0.603500
Epoch 446
Validation auc = 0.585237
Epoch 447
Validation auc = 0.587963
Epoch 448
Loss = 1.1254e-01, PNorm = 95.7352, GNorm = 0.6788, lr_0 = 9.7867e-04
Validation auc = 0.594178
Epoch 449
Validation auc = 0.609388
Epoch 450
Validation auc = 0.623399
Epoch 451
Validation auc = 0.612332
Epoch 452
Loss = 4.6595e-02, PNorm = 96.4155, GNorm = 0.4079, lr_0 = 9.7845e-04
Loss = 3.4271e-03, PNorm = 96.4553, GNorm = 0.0837, lr_0 = 9.7843e-04
Validation auc = 0.599248
Epoch 453
Validation auc = 0.592270
Epoch 454
Validation auc = 0.595050
Epoch 455
Validation auc = 0.604263
Epoch 456
Validation auc = 0.570027
Epoch 457
Loss = 3.2245e-01, PNorm = 96.8964, GNorm = 1.8525, lr_0 = 9.7819e-04
Loss = 8.0193e-03, PNorm = 96.9337, GNorm = 0.3984, lr_0 = 9.7817e-04
Validation auc = 0.578313
Epoch 458
Validation auc = 0.579131
Epoch 459
Validation auc = 0.600774
Epoch 460
Validation auc = 0.654037
Epoch 461
Validation auc = 0.688273
Epoch 462
Loss = 9.8061e-02, PNorm = 97.5921, GNorm = 1.0345, lr_0 = 9.7794e-04
Validation auc = 0.690182
Epoch 463
Validation auc = 0.674481
Epoch 464
Validation auc = 0.665322
Epoch 465
Validation auc = 0.665867
Epoch 466
Loss = 1.4368e-01, PNorm = 98.1388, GNorm = 8.3358, lr_0 = 9.7770e-04
Validation auc = 0.674045
Epoch 467
Validation auc = 0.679660
Epoch 468
Validation auc = 0.688982
Epoch 469
Validation auc = 0.690781
Epoch 470
Validation auc = 0.685384
Epoch 471
Loss = 1.6090e-01, PNorm = 98.6113, GNorm = 2.2234, lr_0 = 9.7746e-04
Loss = 2.0403e-03, PNorm = 98.6425, GNorm = 0.0606, lr_0 = 9.7744e-04
Validation auc = 0.677316
Epoch 472
Validation auc = 0.667448
Epoch 473
Validation auc = 0.662869
Epoch 474
Validation auc = 0.661833
Epoch 475
Validation auc = 0.654255
Epoch 476
Loss = 2.3599e-02, PNorm = 98.9198, GNorm = 0.3934, lr_0 = 9.7721e-04
Validation auc = 0.648258
Epoch 477
Validation auc = 0.663632
Epoch 478
Validation auc = 0.670446
Epoch 479
Validation auc = 0.664722
Epoch 480
Validation auc = 0.648204
Epoch 481
Loss = 2.0707e-01, PNorm = 99.2125, GNorm = 1.2545, lr_0 = 9.7695e-04
Validation auc = 0.618765
Epoch 482
Validation auc = 0.610151
Epoch 483
Validation auc = 0.623453
Epoch 484
Validation auc = 0.630322
Epoch 485
Loss = 1.1974e-01, PNorm = 99.8276, GNorm = 0.9130, lr_0 = 9.7673e-04
Loss = 5.5353e-02, PNorm = 99.8690, GNorm = 1.3164, lr_0 = 9.7671e-04
Validation auc = 0.632939
Epoch 486
Validation auc = 0.623126
Epoch 487
Validation auc = 0.605408
Epoch 488
Validation auc = 0.604863
Epoch 489
Validation auc = 0.613695
Epoch 490
Loss = 8.5232e-02, PNorm = 100.4185, GNorm = 0.9335, lr_0 = 9.7647e-04
Loss = 2.7104e-01, PNorm = 100.4492, GNorm = 2.8683, lr_0 = 9.7645e-04
Validation auc = 0.625089
Epoch 491
Validation auc = 0.618219
Epoch 492
Validation auc = 0.606171
Epoch 493
Validation auc = 0.598648
Epoch 494
Validation auc = 0.583928
Epoch 495
Loss = 3.1258e-02, PNorm = 100.8319, GNorm = 0.3344, lr_0 = 9.7623e-04
Validation auc = 0.580985
Epoch 496
Validation auc = 0.586763
Epoch 497
Validation auc = 0.584147
Epoch 498
Validation auc = 0.585346
Epoch 499
Loss = 4.5905e-02, PNorm = 101.1697, GNorm = 1.8320, lr_0 = 9.7599e-04
Validation auc = 0.584474
Epoch 500
Validation auc = 0.589707
Epoch 501
Validation auc = 0.594178
Epoch 502
Validation auc = 0.597231
Epoch 503
Validation auc = 0.589816
Epoch 504
Loss = 3.5867e-02, PNorm = 101.3833, GNorm = 0.7342, lr_0 = 9.7574e-04
Loss = 1.5712e-02, PNorm = 101.3975, GNorm = 0.5483, lr_0 = 9.7573e-04
Validation auc = 0.570245
Epoch 505
Validation auc = 0.593851
Epoch 506
Validation auc = 0.605354
Epoch 507
Validation auc = 0.614785
Epoch 508
Validation auc = 0.619473
Epoch 509
Loss = 7.0899e-02, PNorm = 101.5581, GNorm = 0.9278, lr_0 = 9.7550e-04
Validation auc = 0.616638
Epoch 510
Validation auc = 0.616857
Epoch 511
Validation auc = 0.623290
Epoch 512
Validation auc = 0.629341
Epoch 513
Validation auc = 0.632230
Epoch 514
Loss = 1.9530e-02, PNorm = 101.6537, GNorm = 0.4335, lr_0 = 9.7524e-04
Validation auc = 0.632721
Epoch 515
Validation auc = 0.633375
Epoch 516
Validation auc = 0.633103
Epoch 517
Validation auc = 0.631685
Epoch 518
Loss = 2.6039e-03, PNorm = 101.7195, GNorm = 0.0497, lr_0 = 9.7502e-04
Loss = 1.0659e-02, PNorm = 101.7239, GNorm = 0.2489, lr_0 = 9.7500e-04
Validation auc = 0.631303
Epoch 519
Validation auc = 0.635665
Epoch 520
Validation auc = 0.641607
Epoch 521
Validation auc = 0.641335
Epoch 522
Validation auc = 0.621163
Epoch 523
Loss = 9.0755e-03, PNorm = 101.9011, GNorm = 0.1238, lr_0 = 9.7476e-04
Loss = 2.1577e-01, PNorm = 101.9190, GNorm = 3.4955, lr_0 = 9.7474e-04
Validation auc = 0.614131
Epoch 524
Validation auc = 0.618710
Epoch 525
Validation auc = 0.618819
Epoch 526
Validation auc = 0.608679
Epoch 527
Validation auc = 0.592924
Epoch 528
Loss = 8.7080e-03, PNorm = 102.1487, GNorm = 0.1426, lr_0 = 9.7452e-04
Validation auc = 0.579295
Epoch 529
Validation auc = 0.583438
Epoch 530
Validation auc = 0.579240
Epoch 531
Validation auc = 0.579567
Epoch 532
Validation auc = 0.583874
Epoch 533
Loss = 6.1533e-03, PNorm = 102.2599, GNorm = 0.1321, lr_0 = 9.7426e-04
Validation auc = 0.586491
Epoch 534
Validation auc = 0.590307
Epoch 535
Validation auc = 0.592760
Epoch 536
Validation auc = 0.593142
Epoch 537
Loss = 7.3307e-03, PNorm = 102.3357, GNorm = 0.0339, lr_0 = 9.7403e-04
Loss = 8.9892e-03, PNorm = 102.3406, GNorm = 0.3694, lr_0 = 9.7401e-04
Validation auc = 0.592869
Epoch 538
Validation auc = 0.591997
Epoch 539
Validation auc = 0.590798
Epoch 540
Validation auc = 0.589707
Epoch 541
Validation auc = 0.589326
Epoch 542
Loss = 7.1690e-03, PNorm = 102.3955, GNorm = 0.1916, lr_0 = 9.7379e-04
Validation auc = 0.591288
Epoch 543
Validation auc = 0.585182
Epoch 544
Validation auc = 0.580548
Epoch 545
Validation auc = 0.579076
Epoch 546
Validation auc = 0.579295
Epoch 547
Loss = 7.1273e-03, PNorm = 102.4533, GNorm = 0.1408, lr_0 = 9.7353e-04
Validation auc = 0.575260
Epoch 548
Validation auc = 0.579949
Epoch 549
Validation auc = 0.599520
Epoch 550
Validation auc = 0.589108
Epoch 551
Loss = 3.9080e-02, PNorm = 102.6397, GNorm = 0.0865, lr_0 = 9.7331e-04
Loss = 4.5554e-04, PNorm = 102.6527, GNorm = 0.0183, lr_0 = 9.7329e-04
Validation auc = 0.562340
Epoch 552
Validation auc = 0.566156
Epoch 553
Validation auc = 0.575696
Epoch 554
Validation auc = 0.585673
Epoch 555
Validation auc = 0.595922
Epoch 556
Loss = 3.6441e-03, PNorm = 102.8508, GNorm = 0.0777, lr_0 = 9.7305e-04
Loss = 5.7334e-03, PNorm = 102.8612, GNorm = 0.1726, lr_0 = 9.7303e-04
Validation auc = 0.603336
Epoch 557
Validation auc = 0.607698
Epoch 558
Validation auc = 0.608843
Epoch 559
Validation auc = 0.608516
Epoch 560
Validation auc = 0.594559
Epoch 561
Loss = 1.4285e-01, PNorm = 102.9496, GNorm = 0.7655, lr_0 = 9.7281e-04
Validation auc = 0.591833
Epoch 562
Validation auc = 0.591125
Epoch 563
Validation auc = 0.591833
Epoch 564
Validation auc = 0.591997
Epoch 565
Validation auc = 0.593960
Epoch 566
Loss = 2.2741e-03, PNorm = 103.0272, GNorm = 0.0445, lr_0 = 9.7255e-04
Validation auc = 0.597994
Epoch 567
Validation auc = 0.604154
Epoch 568
Validation auc = 0.606771
Epoch 569
Validation auc = 0.609170
Epoch 570
Loss = 2.1923e-02, PNorm = 103.0891, GNorm = 0.6990, lr_0 = 9.7232e-04
Loss = 3.5108e-03, PNorm = 103.0923, GNorm = 0.1213, lr_0 = 9.7231e-04
Validation auc = 0.600447
Epoch 571
Validation auc = 0.598048
Epoch 572
Validation auc = 0.596576
Epoch 573
Validation auc = 0.597776
Epoch 574
Validation auc = 0.601428
Epoch 575
Loss = 3.5338e-03, PNorm = 103.1335, GNorm = 0.0652, lr_0 = 9.7208e-04
Validation auc = 0.603936
Epoch 576
Validation auc = 0.606935
Epoch 577
Validation auc = 0.608243
Epoch 578
Validation auc = 0.605517
Epoch 579
Validation auc = 0.600174
Epoch 580
Loss = 1.4364e-03, PNorm = 103.1747, GNorm = 0.0276, lr_0 = 9.7182e-04
Validation auc = 0.594723
Epoch 581
Validation auc = 0.594777
Epoch 582
Validation auc = 0.600393
Epoch 583
Validation auc = 0.598266
Epoch 584
Loss = 9.8328e-03, PNorm = 103.2094, GNorm = 0.5621, lr_0 = 9.7160e-04
Loss = 3.0173e-02, PNorm = 103.2147, GNorm = 0.7888, lr_0 = 9.7158e-04
Validation auc = 0.597612
Epoch 585
Validation auc = 0.595431
Epoch 586
Validation auc = 0.593142
Epoch 587
Validation auc = 0.588889
Epoch 588
Validation auc = 0.584310
Epoch 589
Loss = 2.2689e-03, PNorm = 103.2781, GNorm = 0.0356, lr_0 = 9.7134e-04
Loss = 9.3900e-04, PNorm = 103.2812, GNorm = 0.0175, lr_0 = 9.7132e-04
Validation auc = 0.581584
Epoch 590
Validation auc = 0.580876
Epoch 591
Validation auc = 0.581148
Epoch 592
Validation auc = 0.581802
Epoch 593
Validation auc = 0.583492
Epoch 594
Loss = 6.2798e-03, PNorm = 103.3095, GNorm = 0.1605, lr_0 = 9.7110e-04
Validation auc = 0.585346
Epoch 595
Validation auc = 0.587036
Epoch 596
Validation auc = 0.585673
Epoch 597
Validation auc = 0.584419
Epoch 598
Validation auc = 0.580821
Epoch 599
Loss = 1.9575e-03, PNorm = 103.3369, GNorm = 0.0367, lr_0 = 9.7084e-04
Validation auc = 0.575151
Epoch 600
Validation auc = 0.569482
Epoch 601
Validation auc = 0.565556
Epoch 602
Validation auc = 0.561631
Epoch 603
Loss = 1.2224e-03, PNorm = 103.3538, GNorm = 0.0222, lr_0 = 9.7062e-04
Loss = 9.7213e-05, PNorm = 103.3551, GNorm = 0.0038, lr_0 = 9.7060e-04
Validation auc = 0.559669
Epoch 604
Validation auc = 0.559232
Epoch 605
Validation auc = 0.559723
Epoch 606
Validation auc = 0.559450
Epoch 607
Validation auc = 0.559396
Epoch 608
Loss = 5.2366e-04, PNorm = 103.3728, GNorm = 0.0115, lr_0 = 9.7036e-04
Validation auc = 0.557924
Epoch 609
Validation auc = 0.559887
Epoch 610
Validation auc = 0.562176
Epoch 611
Validation auc = 0.560268
Epoch 612
Validation auc = 0.558687
Epoch 613
Loss = 9.3586e-04, PNorm = 103.3929, GNorm = 0.0194, lr_0 = 9.7012e-04
Validation auc = 0.556125
Epoch 614
Validation auc = 0.554926
Epoch 615
Validation auc = 0.557488
Epoch 616
Validation auc = 0.559450
Epoch 617
Loss = 1.5510e-03, PNorm = 103.4070, GNorm = 0.0622, lr_0 = 9.6990e-04
Loss = 1.4706e-03, PNorm = 103.4087, GNorm = 0.0479, lr_0 = 9.6988e-04
Validation auc = 0.561468
Epoch 618
Validation auc = 0.563485
Epoch 619
Validation auc = 0.564084
Epoch 620
Validation auc = 0.565829
Epoch 621
Validation auc = 0.567410
Epoch 622
Loss = 4.2553e-02, PNorm = 103.4283, GNorm = 0.9322, lr_0 = 9.6964e-04
Loss = 1.0855e-03, PNorm = 103.4280, GNorm = 0.0409, lr_0 = 9.6962e-04
Validation auc = 0.568173
Epoch 623
Validation auc = 0.569263
Epoch 624
Validation auc = 0.570517
Epoch 625
Validation auc = 0.575097
Epoch 626
Validation auc = 0.587418
Epoch 627
Loss = 1.0108e-03, PNorm = 103.4970, GNorm = 0.0303, lr_0 = 9.6940e-04
Validation auc = 0.597994
Epoch 628
Validation auc = 0.607861
Epoch 629
Validation auc = 0.611787
Epoch 630
Validation auc = 0.613967
Epoch 631
Validation auc = 0.613749
Epoch 632
Loss = 6.9141e-03, PNorm = 103.6078, GNorm = 0.2231, lr_0 = 9.6914e-04
Validation auc = 0.613749
Epoch 633
Validation auc = 0.617075
Epoch 634
Validation auc = 0.620346
Epoch 635
Validation auc = 0.621218
Epoch 636
Loss = 2.4686e-03, PNorm = 103.6628, GNorm = 0.0635, lr_0 = 9.6892e-04
Loss = 3.1967e-04, PNorm = 103.6659, GNorm = 0.0130, lr_0 = 9.6890e-04
Validation auc = 0.621600
Epoch 637
Validation auc = 0.621818
Epoch 638
Validation auc = 0.622635
Epoch 639
Validation auc = 0.623017
Epoch 640
Validation auc = 0.623508
Epoch 641
Loss = 9.8004e-04, PNorm = 103.6975, GNorm = 0.0372, lr_0 = 9.6866e-04
Validation auc = 0.623071
Epoch 642
Validation auc = 0.617783
Epoch 643
Validation auc = 0.612768
Epoch 644
Validation auc = 0.610587
Epoch 645
Validation auc = 0.607698
Epoch 646
Loss = 2.6786e-03, PNorm = 103.7117, GNorm = 0.0628, lr_0 = 9.6842e-04
Validation auc = 0.606771
Epoch 647
Validation auc = 0.603554
Epoch 648
Validation auc = 0.597721
Epoch 649
Validation auc = 0.594505
Epoch 650
Loss = 1.7370e-03, PNorm = 103.7551, GNorm = 0.0908, lr_0 = 9.6820e-04
Loss = 7.7127e-04, PNorm = 103.7579, GNorm = 0.0181, lr_0 = 9.6818e-04
Validation auc = 0.591942
Epoch 651
Validation auc = 0.587690
Epoch 652
Validation auc = 0.577496
Epoch 653
Validation auc = 0.573352
Epoch 654
Validation auc = 0.578749
Epoch 655
Loss = 8.1615e-04, PNorm = 103.7991, GNorm = 0.0196, lr_0 = 9.6794e-04
Loss = 1.3781e-03, PNorm = 103.8026, GNorm = 0.0281, lr_0 = 9.6792e-04
Validation auc = 0.583765
Epoch 656
Validation auc = 0.587581
Epoch 657
Validation auc = 0.591288
Epoch 658
Validation auc = 0.593523
Epoch 659
Validation auc = 0.594886
Epoch 660
Loss = 1.5372e-04, PNorm = 103.8368, GNorm = 0.0026, lr_0 = 9.6770e-04
Validation auc = 0.597122
Epoch 661
Validation auc = 0.597558
Epoch 662
Validation auc = 0.598539
Epoch 663
Validation auc = 0.599193
Epoch 664
Validation auc = 0.599575
Epoch 665
Loss = 1.1500e-04, PNorm = 103.8527, GNorm = 0.0021, lr_0 = 9.6744e-04
Validation auc = 0.598321
Epoch 666
Validation auc = 0.591997
Epoch 667
Validation auc = 0.589162
Epoch 668
Validation auc = 0.586327
Epoch 669
Loss = 1.8434e-03, PNorm = 103.8800, GNorm = 0.0134, lr_0 = 9.6722e-04
Loss = 8.6918e-04, PNorm = 103.8835, GNorm = 0.0429, lr_0 = 9.6720e-04
Validation auc = 0.585564
Epoch 670
Validation auc = 0.584419
Epoch 671
Validation auc = 0.585509
Epoch 672
Validation auc = 0.583438
Epoch 673
Validation auc = 0.581148
Epoch 674
Loss = 5.0865e-04, PNorm = 103.9184, GNorm = 0.0170, lr_0 = 9.6696e-04
Validation auc = 0.580167
Epoch 675
Validation auc = 0.580276
Epoch 676
Validation auc = 0.571172
Epoch 677
Validation auc = 0.563158
Epoch 678
Validation auc = 0.556779
Epoch 679
Loss = 1.7683e-03, PNorm = 103.9396, GNorm = 0.0453, lr_0 = 9.6672e-04
Validation auc = 0.552908
Epoch 680
Validation auc = 0.550074
Epoch 681
Validation auc = 0.549147
Epoch 682
Validation auc = 0.551273
Epoch 683
Loss = 6.8673e-04, PNorm = 103.9647, GNorm = 0.0281, lr_0 = 9.6648e-04
Validation auc = 0.552908
Epoch 684
Validation auc = 0.556179
Epoch 685
Validation auc = 0.557052
Epoch 686
Validation auc = 0.557815
Epoch 687
Validation auc = 0.555798
Epoch 688
Loss = 3.8677e-04, PNorm = 103.9872, GNorm = 0.0094, lr_0 = 9.6624e-04
Loss = 6.2460e-05, PNorm = 103.9881, GNorm = 0.0025, lr_0 = 9.6622e-04
Validation auc = 0.553508
Epoch 689
Validation auc = 0.551764
Epoch 690
Validation auc = 0.550455
Epoch 691
Validation auc = 0.549528
Epoch 692
Validation auc = 0.548765
Epoch 693
Loss = 7.2149e-03, PNorm = 103.9963, GNorm = 0.2385, lr_0 = 9.6600e-04
Validation auc = 0.548002
Epoch 694
Validation auc = 0.547784
Epoch 695
Validation auc = 0.547566
Epoch 696
Validation auc = 0.548493
Epoch 697
Validation auc = 0.548656
Epoch 698
Loss = 1.5755e-03, PNorm = 104.0043, GNorm = 0.0958, lr_0 = 9.6574e-04
Validation auc = 0.549419
Epoch 699
Validation auc = 0.550074
Epoch 700
Validation auc = 0.550346
Epoch 701
Validation auc = 0.551000
Epoch 702
Loss = 5.5805e-04, PNorm = 104.0097, GNorm = 0.0363, lr_0 = 9.6552e-04
Loss = 2.5372e-04, PNorm = 104.0102, GNorm = 0.0114, lr_0 = 9.6550e-04
Validation auc = 0.551818
Epoch 703
Validation auc = 0.552200
Epoch 704
Validation auc = 0.552908
Epoch 705
Validation auc = 0.553508
Epoch 706
Validation auc = 0.553835
Epoch 707
Loss = 2.1445e-04, PNorm = 104.0157, GNorm = 0.0026, lr_0 = 9.6526e-04
Loss = 3.2130e-04, PNorm = 104.0161, GNorm = 0.0087, lr_0 = 9.6525e-04
Validation auc = 0.554326
Epoch 708
Validation auc = 0.554708
Epoch 709
Validation auc = 0.555362
Epoch 710
Validation auc = 0.555689
Epoch 711
Validation auc = 0.556070
Epoch 712
Loss = 1.5775e-04, PNorm = 104.0200, GNorm = 0.0025, lr_0 = 9.6502e-04
Validation auc = 0.556398
Epoch 713
Validation auc = 0.556670
Epoch 714
Validation auc = 0.556943
Epoch 715
Validation auc = 0.556834
Epoch 716
Loss = 7.5217e-03, PNorm = 104.0220, GNorm = 1.0822, lr_0 = 9.6479e-04
Validation auc = 0.559778
Epoch 717
Validation auc = 0.563430
Epoch 718
Validation auc = 0.566756
Epoch 719
Validation auc = 0.569536
Epoch 720
Validation auc = 0.570790
Epoch 721
Loss = 1.3797e-03, PNorm = 104.0257, GNorm = 0.0151, lr_0 = 9.6455e-04
Loss = 2.6040e-04, PNorm = 104.0266, GNorm = 0.0104, lr_0 = 9.6453e-04
Validation auc = 0.571662
Epoch 722
Validation auc = 0.565011
Epoch 723
Validation auc = 0.548602
Epoch 724
Validation auc = 0.594559
Epoch 725
Validation auc = 0.609224
Epoch 726
Loss = 1.0307e-02, PNorm = 104.0736, GNorm = 0.3562, lr_0 = 9.6431e-04
Validation auc = 0.614785
Epoch 727
Validation auc = 0.612332
Epoch 728
Validation auc = 0.612550
Epoch 729
Validation auc = 0.613640
Epoch 730
Validation auc = 0.616148
Epoch 731
Loss = 5.0298e-04, PNorm = 104.1106, GNorm = 0.0121, lr_0 = 9.6405e-04
Validation auc = 0.617293
Epoch 732
Validation auc = 0.618165
Epoch 733
Validation auc = 0.618438
Epoch 734
Validation auc = 0.618710
Epoch 735
Loss = 2.9146e-04, PNorm = 104.1303, GNorm = 0.0046, lr_0 = 9.6383e-04
Loss = 9.9449e-05, PNorm = 104.1314, GNorm = 0.0032, lr_0 = 9.6381e-04
Validation auc = 0.619255
Epoch 736
Validation auc = 0.619528
Epoch 737
Validation auc = 0.619746
Epoch 738
Validation auc = 0.620182
Epoch 739
Validation auc = 0.619964
Epoch 740
Loss = 3.1722e-04, PNorm = 104.1416, GNorm = 0.0096, lr_0 = 9.6357e-04
Loss = 1.0165e-04, PNorm = 104.1420, GNorm = 0.0036, lr_0 = 9.6355e-04
Validation auc = 0.619800
Epoch 741
Validation auc = 0.620182
Epoch 742
Validation auc = 0.618056
Epoch 743
Validation auc = 0.615821
Epoch 744
Validation auc = 0.614730
Epoch 745
Loss = 5.8040e-04, PNorm = 104.1599, GNorm = 0.0174, lr_0 = 9.6333e-04
Validation auc = 0.618601
Epoch 746
Validation auc = 0.625906
Epoch 747
Validation auc = 0.632666
Epoch 748
Validation auc = 0.635283
Epoch 749
Loss = 1.1152e-03, PNorm = 104.2379, GNorm = 0.0045, lr_0 = 9.6309e-04
Validation auc = 0.637246
Epoch 750
Validation auc = 0.637736
Epoch 751
Validation auc = 0.638282
Epoch 752
Validation auc = 0.638718
Epoch 753
Validation auc = 0.638336
Epoch 754
Loss = 1.8888e-04, PNorm = 104.2879, GNorm = 0.0068, lr_0 = 9.6285e-04
Loss = 6.0666e-04, PNorm = 104.2901, GNorm = 0.0135, lr_0 = 9.6284e-04
Validation auc = 0.635937
Epoch 755
Validation auc = 0.643842
Epoch 756
Validation auc = 0.632721
Epoch 757
Validation auc = 0.621981
Epoch 758
Validation auc = 0.615330
Epoch 759
Loss = 8.4353e-04, PNorm = 104.3093, GNorm = 0.0298, lr_0 = 9.6262e-04
Validation auc = 0.611950
Epoch 760
Validation auc = 0.611405
Epoch 761
Validation auc = 0.610860
Epoch 762
Validation auc = 0.607316
Epoch 763
Validation auc = 0.601265
Epoch 764
Loss = 1.2434e-03, PNorm = 104.3295, GNorm = 0.0359, lr_0 = 9.6236e-04
Validation auc = 0.602192
Epoch 765
Validation auc = 0.605517
Epoch 766
Validation auc = 0.606935
Epoch 767
Validation auc = 0.608079
Epoch 768
Loss = 6.6303e-04, PNorm = 104.3517, GNorm = 0.0096, lr_0 = 9.6214e-04
Loss = 2.4843e-04, PNorm = 104.3529, GNorm = 0.0073, lr_0 = 9.6212e-04
Validation auc = 0.609279
Epoch 769
Validation auc = 0.610860
Epoch 770
Validation auc = 0.611787
Epoch 771
Validation auc = 0.612768
Epoch 772
Validation auc = 0.613640
Epoch 773
Loss = 2.9843e-03, PNorm = 104.3799, GNorm = 0.1995, lr_0 = 9.6188e-04
Loss = 1.6090e-02, PNorm = 104.3842, GNorm = 0.9884, lr_0 = 9.6186e-04
Validation auc = 0.613531
Epoch 774
Validation auc = 0.612877
Epoch 775
Validation auc = 0.611078
Epoch 776
Validation auc = 0.612931
Epoch 777
Validation auc = 0.612877
Epoch 778
Loss = 5.1174e-04, PNorm = 104.4299, GNorm = 0.0115, lr_0 = 9.6164e-04
Validation auc = 0.615385
Epoch 779
Validation auc = 0.617674
Epoch 780
Validation auc = 0.618928
Epoch 781
Validation auc = 0.619746
Epoch 782
Validation auc = 0.614676
Epoch 783
Loss = 3.3125e-04, PNorm = 104.4577, GNorm = 0.0089, lr_0 = 9.6139e-04
Validation auc = 0.609115
Epoch 784
Validation auc = 0.609061
Epoch 785
Validation auc = 0.608134
Epoch 786
Validation auc = 0.607807
Epoch 787
Loss = 2.9313e-02, PNorm = 104.6650, GNorm = 0.4372, lr_0 = 9.6117e-04
Loss = 5.0109e-03, PNorm = 104.6791, GNorm = 0.1762, lr_0 = 9.6115e-04
Validation auc = 0.610369
Epoch 788
Validation auc = 0.611623
Epoch 789
Validation auc = 0.611787
Epoch 790
Validation auc = 0.607916
Epoch 791
Validation auc = 0.601374
Epoch 792
Loss = 6.3692e-03, PNorm = 104.7983, GNorm = 0.1500, lr_0 = 9.6093e-04
Validation auc = 0.595868
Epoch 793
Validation auc = 0.594995
Epoch 794
Validation auc = 0.594341
Epoch 795
Validation auc = 0.593033
Epoch 796
Validation auc = 0.592869
Epoch 797
Loss = 3.0559e-03, PNorm = 104.8881, GNorm = 0.0610, lr_0 = 9.6067e-04
Validation auc = 0.592324
Epoch 798
Validation auc = 0.591615
Epoch 799
Validation auc = 0.591997
Epoch 800
Validation auc = 0.591833
Epoch 801
Loss = 8.4801e-03, PNorm = 104.9228, GNorm = 0.3239, lr_0 = 9.6045e-04
Loss = 4.9074e-03, PNorm = 104.9259, GNorm = 0.1234, lr_0 = 9.6043e-04
Validation auc = 0.594614
Epoch 802
Validation auc = 0.598321
Epoch 803
Validation auc = 0.606498
Epoch 804
Validation auc = 0.623399
Epoch 805
Validation auc = 0.619146
Epoch 806
Loss = 8.4035e-03, PNorm = 105.1254, GNorm = 0.4927, lr_0 = 9.6019e-04
Loss = 1.5888e-01, PNorm = 105.1678, GNorm = 7.5401, lr_0 = 9.6018e-04
Validation auc = 0.586818
Epoch 807
Validation auc = 0.640844
Epoch 808
Validation auc = 0.645750
Epoch 809
Validation auc = 0.656545
Epoch 810
Validation auc = 0.607534
Epoch 811
Loss = 8.8362e-02, PNorm = 106.0328, GNorm = 1.2130, lr_0 = 9.5996e-04
Validation auc = 0.608188
Epoch 812
Validation auc = 0.624707
Epoch 813
Validation auc = 0.639917
Epoch 814
Validation auc = 0.647986
Epoch 815
Validation auc = 0.661996
Epoch 816
Loss = 1.1599e-02, PNorm = 106.7840, GNorm = 0.2049, lr_0 = 9.5970e-04
Validation auc = 0.670828
Epoch 817
Validation auc = 0.673881
Epoch 818
Validation auc = 0.674263
Epoch 819
Validation auc = 0.673118
Epoch 820
Loss = 9.1401e-03, PNorm = 107.0988, GNorm = 0.2705, lr_0 = 9.5948e-04
Loss = 3.7932e-03, PNorm = 107.1137, GNorm = 0.2260, lr_0 = 9.5946e-04
Validation auc = 0.668920
Epoch 821
Validation auc = 0.663686
Epoch 822
Validation auc = 0.660415
Epoch 823
Validation auc = 0.657799
Epoch 824
Validation auc = 0.657417
Epoch 825
Loss = 9.7425e-03, PNorm = 107.2408, GNorm = 0.2721, lr_0 = 9.5924e-04
Validation auc = 0.658998
Epoch 826
Validation auc = 0.658780
Epoch 827
Validation auc = 0.661124
Epoch 828
Validation auc = 0.660797
Epoch 829
Validation auc = 0.663741
Epoch 830
Loss = 1.0214e-03, PNorm = 107.3066, GNorm = 0.0175, lr_0 = 9.5899e-04
Validation auc = 0.664341
Epoch 831
Validation auc = 0.661996
Epoch 832
Validation auc = 0.656599
Epoch 833
Validation auc = 0.653056
Epoch 834
Loss = 2.3759e-03, PNorm = 107.3594, GNorm = 0.0464, lr_0 = 9.5877e-04
Loss = 1.8394e-03, PNorm = 107.3637, GNorm = 0.1249, lr_0 = 9.5875e-04
Validation auc = 0.651856
Epoch 835
Validation auc = 0.649239
Epoch 836
Validation auc = 0.649512
Epoch 837
Validation auc = 0.651093
Epoch 838
Validation auc = 0.664613
Epoch 839
Loss = 3.1630e-01, PNorm = 107.4471, GNorm = 10.5204, lr_0 = 9.5851e-04
Loss = 1.5304e-03, PNorm = 107.4745, GNorm = 0.0525, lr_0 = 9.5849e-04
Validation auc = 0.636701
Epoch 840
Validation auc = 0.622363
Epoch 841
Validation auc = 0.601483
Epoch 842
Validation auc = 0.591016
Epoch 843
Validation auc = 0.576787
Epoch 844
Loss = 4.4637e-02, PNorm = 107.9534, GNorm = 0.7828, lr_0 = 9.5827e-04
Validation auc = 0.569427
Epoch 845
Validation auc = 0.562776
Epoch 846
Validation auc = 0.556670
Epoch 847
Validation auc = 0.550019
Epoch 848
Validation auc = 0.551055
Epoch 849
Loss = 3.0982e-02, PNorm = 108.2471, GNorm = 1.0026, lr_0 = 9.5802e-04
Validation auc = 0.557379
Epoch 850
Validation auc = 0.564793
Epoch 851
Validation auc = 0.571989
Epoch 852
Validation auc = 0.575206
Epoch 853
Loss = 1.3468e-02, PNorm = 108.3559, GNorm = 0.0508, lr_0 = 9.5780e-04
Loss = 8.7865e-04, PNorm = 108.3640, GNorm = 0.0187, lr_0 = 9.5778e-04
Validation auc = 0.574279
Epoch 854
Validation auc = 0.573570
Epoch 855
Validation auc = 0.574552
Epoch 856
Validation auc = 0.575915
Epoch 857
Validation auc = 0.577823
Epoch 858
Loss = 2.1032e-02, PNorm = 108.4528, GNorm = 0.7820, lr_0 = 9.5754e-04
Validation auc = 0.578368
Epoch 859
Validation auc = 0.578967
Epoch 860
Validation auc = 0.580167
Epoch 861
Validation auc = 0.581639
Epoch 862
Validation auc = 0.585618
Epoch 863
Loss = 1.3059e-03, PNorm = 108.5104, GNorm = 0.0264, lr_0 = 9.5730e-04
Validation auc = 0.588453
Epoch 864
Validation auc = 0.591670
Epoch 865
Validation auc = 0.595213
Epoch 866
Validation auc = 0.595868
Epoch 867
Loss = 3.0412e-03, PNorm = 108.5602, GNorm = 0.0462, lr_0 = 9.5708e-04
Loss = 1.9755e-03, PNorm = 108.5636, GNorm = 0.0403, lr_0 = 9.5707e-04
Validation auc = 0.597340
Epoch 868
Validation auc = 0.598103
Epoch 869
Validation auc = 0.595977
Epoch 870
Validation auc = 0.596849
Epoch 871
Validation auc = 0.606444
Epoch 872
Loss = 4.0275e-02, PNorm = 108.6584, GNorm = 0.1309, lr_0 = 9.5683e-04
Loss = 6.5858e-04, PNorm = 108.6668, GNorm = 0.0262, lr_0 = 9.5681e-04
Validation auc = 0.610151
Epoch 873
Validation auc = 0.610969
Epoch 874
Validation auc = 0.610424
Epoch 875
Validation auc = 0.610151
Epoch 876
Validation auc = 0.609824
Epoch 877
Loss = 1.5918e-03, PNorm = 108.7587, GNorm = 0.0422, lr_0 = 9.5659e-04
Validation auc = 0.609279
Epoch 878
Validation auc = 0.611896
Epoch 879
Validation auc = 0.618983
Epoch 880
Validation auc = 0.623508
Epoch 881
Validation auc = 0.626724
Epoch 882
Loss = 3.5825e-03, PNorm = 108.8515, GNorm = 0.0712, lr_0 = 9.5634e-04
Validation auc = 0.628632
Epoch 883
Validation auc = 0.628632
Epoch 884
Validation auc = 0.628251
Epoch 885
Validation auc = 0.627051
Epoch 886
Loss = 3.6460e-03, PNorm = 108.9031, GNorm = 0.1663, lr_0 = 9.5612e-04
Loss = 2.1035e-04, PNorm = 108.9057, GNorm = 0.0062, lr_0 = 9.5610e-04
Validation auc = 0.626397
Epoch 887
Validation auc = 0.623780
Epoch 888
Validation auc = 0.621545
Epoch 889
Validation auc = 0.618928
Epoch 890
Validation auc = 0.618656
Epoch 891
Loss = 2.2174e-03, PNorm = 108.9467, GNorm = 0.0858, lr_0 = 9.5586e-04
Validation auc = 0.618438
Epoch 892
Validation auc = 0.617347
Epoch 893
Validation auc = 0.615494
Epoch 894
Validation auc = 0.613586
Epoch 895
Validation auc = 0.616093
Epoch 896
Loss = 1.6957e-02, PNorm = 108.9660, GNorm = 0.8896, lr_0 = 9.5563e-04
Validation auc = 0.615712
Epoch 897
Validation auc = 0.615712
Epoch 898
Validation auc = 0.613858
Epoch 899
Validation auc = 0.611896
Epoch 900
Loss = 2.7427e-03, PNorm = 108.9867, GNorm = 0.1165, lr_0 = 9.5541e-04
Loss = 8.3009e-04, PNorm = 108.9892, GNorm = 0.0300, lr_0 = 9.5539e-04
Validation auc = 0.611132
Epoch 901
Validation auc = 0.610533
Epoch 902
Validation auc = 0.610587
Epoch 903
Validation auc = 0.609933
Epoch 904
Validation auc = 0.610424
Epoch 905
Loss = 1.2770e-03, PNorm = 109.0231, GNorm = 0.0567, lr_0 = 9.5515e-04
Loss = 1.1577e-03, PNorm = 109.0251, GNorm = 0.0514, lr_0 = 9.5513e-04
Validation auc = 0.611078
Epoch 906
Validation auc = 0.608297
Epoch 907
Validation auc = 0.607098
Epoch 908
Validation auc = 0.617238
Epoch 909
Validation auc = 0.632994
Epoch 910
Loss = 2.8969e-02, PNorm = 109.1173, GNorm = 0.7684, lr_0 = 9.5491e-04
Validation auc = 0.629777
Epoch 911
Validation auc = 0.618983
Epoch 912
Validation auc = 0.612223
Epoch 913
Validation auc = 0.604699
Epoch 914
Validation auc = 0.601047
Epoch 915
Loss = 8.7087e-02, PNorm = 109.4324, GNorm = 1.2822, lr_0 = 9.5466e-04
Validation auc = 0.591615
Epoch 916
Validation auc = 0.581421
Epoch 917
Validation auc = 0.580548
Epoch 918
Validation auc = 0.584147
Epoch 919
Loss = 3.9445e-03, PNorm = 109.5826, GNorm = 0.0887, lr_0 = 9.5444e-04
Loss = 5.3904e-03, PNorm = 109.5919, GNorm = 0.1366, lr_0 = 9.5442e-04
Validation auc = 0.586709
Epoch 920
Validation auc = 0.591016
Epoch 921
Validation auc = 0.594341
Epoch 922
Validation auc = 0.594832
Epoch 923
Validation auc = 0.591506
Epoch 924
Loss = 3.5508e-03, PNorm = 109.6829, GNorm = 0.0564, lr_0 = 9.5419e-04
Validation auc = 0.588835
Epoch 925
Validation auc = 0.594614
Epoch 926
Validation auc = 0.591343
Epoch 927
Validation auc = 0.590252
Epoch 928
Validation auc = 0.589544
Epoch 929
Loss = 5.1043e-04, PNorm = 109.7895, GNorm = 0.0122, lr_0 = 9.5395e-04
Validation auc = 0.590307
Epoch 930
Validation auc = 0.588562
Epoch 931
Validation auc = 0.587854
Epoch 932
Validation auc = 0.589544
Epoch 933
Loss = 4.0530e-02, PNorm = 109.8299, GNorm = 0.0599, lr_0 = 9.5371e-04
Validation auc = 0.563103
Epoch 934
Validation auc = 0.546094
Epoch 935
Validation auc = 0.539443
Epoch 936
Validation auc = 0.539279
Epoch 937
Validation auc = 0.539388
Epoch 938
Loss = 1.9908e-03, PNorm = 109.8785, GNorm = 0.0146, lr_0 = 9.5348e-04
Loss = 1.8248e-02, PNorm = 109.8814, GNorm = 1.9112, lr_0 = 9.5346e-04
Validation auc = 0.525487
Epoch 939
Validation auc = 0.589489
Epoch 940
Validation auc = 0.686256
Epoch 941
Validation auc = 0.650112
Epoch 942
Validation auc = 0.681459
Epoch 943
Loss = 1.7969e-01, PNorm = 110.1106, GNorm = 2.4921, lr_0 = 9.5324e-04
Validation auc = 0.680532
Epoch 944
Validation auc = 0.668375
Epoch 945
Validation auc = 0.656000
Epoch 946
Validation auc = 0.642588
Epoch 947
Validation auc = 0.633375
Epoch 948
Loss = 7.7711e-03, PNorm = 110.6794, GNorm = 0.2152, lr_0 = 9.5299e-04
Validation auc = 0.622853
Epoch 949
Validation auc = 0.616802
Epoch 950
Validation auc = 0.622417
Epoch 951
Validation auc = 0.631740
Epoch 952
Loss = 5.3105e-03, PNorm = 110.8972, GNorm = 0.1910, lr_0 = 9.5277e-04
Loss = 5.3480e-05, PNorm = 110.9074, GNorm = 0.0017, lr_0 = 9.5275e-04
Validation auc = 0.641007
Epoch 953
Validation auc = 0.647549
Epoch 954
Validation auc = 0.652020
Epoch 955
Validation auc = 0.654746
Epoch 956
Validation auc = 0.657362
Epoch 957
Loss = 6.2120e-02, PNorm = 110.9943, GNorm = 1.1478, lr_0 = 9.5251e-04
Loss = 3.4861e-04, PNorm = 110.9962, GNorm = 0.0135, lr_0 = 9.5250e-04
Validation auc = 0.656436
Epoch 958
Validation auc = 0.655182
Epoch 959
Validation auc = 0.653982
Epoch 960
Validation auc = 0.655781
Epoch 961
Validation auc = 0.656000
Epoch 962
Loss = 3.5140e-04, PNorm = 111.0329, GNorm = 0.0080, lr_0 = 9.5228e-04
Validation auc = 0.653383
Epoch 963
Validation auc = 0.652238
Epoch 964
Validation auc = 0.652620
Epoch 965
Validation auc = 0.650602
Epoch 966
Loss = 4.5190e-03, PNorm = 111.1099, GNorm = 0.0220, lr_0 = 9.5204e-04
Validation auc = 0.649894
Epoch 967
Validation auc = 0.647004
Epoch 968
Validation auc = 0.641444
Epoch 969
Validation auc = 0.651965
Epoch 970
Validation auc = 0.661506
Epoch 971
Loss = 4.1721e-03, PNorm = 111.3208, GNorm = 0.0537, lr_0 = 9.5180e-04
Loss = 8.3247e-06, PNorm = 111.3408, GNorm = 0.0003, lr_0 = 9.5179e-04
Validation auc = 0.669847
Epoch 972
Validation auc = 0.656654
Epoch 973
Validation auc = 0.646514
Epoch 974
Validation auc = 0.662324
Epoch 975
Validation auc = 0.669029
Epoch 976
Loss = 3.4779e-03, PNorm = 111.5614, GNorm = 0.0899, lr_0 = 9.5157e-04
Validation auc = 0.666630
Epoch 977
Validation auc = 0.677697
Epoch 978
Validation auc = 0.682059
Epoch 979
Validation auc = 0.693507
Epoch 980
Validation auc = 0.695361
Epoch 981
Loss = 1.9227e-03, PNorm = 111.7420, GNorm = 0.0620, lr_0 = 9.5132e-04
Validation auc = 0.694379
Epoch 982
Validation auc = 0.693180
Epoch 983
Validation auc = 0.691872
Epoch 984
Validation auc = 0.690127
Epoch 985
Loss = 1.1910e-02, PNorm = 111.8337, GNorm = 1.4178, lr_0 = 9.5110e-04
Loss = 1.8905e-02, PNorm = 111.8381, GNorm = 0.8144, lr_0 = 9.5108e-04
Validation auc = 0.688819
Epoch 986
Validation auc = 0.688382
Epoch 987
Validation auc = 0.687674
Epoch 988
Validation auc = 0.688492
Epoch 989
Validation auc = 0.689037
Epoch 990
Loss = 1.1605e-03, PNorm = 111.8924, GNorm = 0.0152, lr_0 = 9.5084e-04
Loss = 5.9385e-04, PNorm = 111.8948, GNorm = 0.0168, lr_0 = 9.5083e-04
Validation auc = 0.690018
Epoch 991
Validation auc = 0.691326
Epoch 992
Validation auc = 0.693234
Epoch 993
Validation auc = 0.693943
Epoch 994
Validation auc = 0.694597
Epoch 995
Loss = 1.3665e-03, PNorm = 111.9165, GNorm = 0.0276, lr_0 = 9.5061e-04
Validation auc = 0.695143
Epoch 996
Validation auc = 0.695034
Epoch 997
Validation auc = 0.695306
Epoch 998
Validation auc = 0.695579
Epoch 999
Loss = 5.9338e-04, PNorm = 111.9340, GNorm = 0.0072, lr_0 = 9.5037e-04
Validation auc = 0.694870
Epoch 1000
Validation auc = 0.693998
Epoch 1001
Validation auc = 0.692580
Epoch 1002
Validation auc = 0.691817
Epoch 1003
Validation auc = 0.689854
Epoch 1004
Loss = 6.9532e-04, PNorm = 111.9435, GNorm = 0.0307, lr_0 = 9.5014e-04
Loss = 1.4400e-03, PNorm = 111.9439, GNorm = 0.0787, lr_0 = 9.5012e-04
Validation auc = 0.688655
Epoch 1005
Validation auc = 0.687238
Epoch 1006
Validation auc = 0.678024
Epoch 1007
Validation auc = 0.671755
Epoch 1008
Validation auc = 0.668157
Epoch 1009
Loss = 3.4297e-03, PNorm = 111.9466, GNorm = 0.1397, lr_0 = 9.4990e-04
Validation auc = 0.664668
Epoch 1010
Validation auc = 0.663087
Epoch 1011
Validation auc = 0.662160
Epoch 1012
Validation auc = 0.664450
Epoch 1013
Validation auc = 0.666358
Epoch 1014
Loss = 7.8377e-04, PNorm = 111.9617, GNorm = 0.0157, lr_0 = 9.4965e-04
Validation auc = 0.665595
Epoch 1015
Validation auc = 0.675462
Epoch 1016
Validation auc = 0.698414
Epoch 1017
Validation auc = 0.701794
Epoch 1018
Loss = 9.8900e-02, PNorm = 112.2296, GNorm = 0.0138, lr_0 = 9.4943e-04
Loss = 2.7201e-03, PNorm = 112.2665, GNorm = 0.1361, lr_0 = 9.4941e-04
Validation auc = 0.703211
Epoch 1019
Validation auc = 0.701903
Epoch 1020
Validation auc = 0.698741
Epoch 1021
Validation auc = 0.692580
Epoch 1022
Validation auc = 0.685330
Epoch 1023
Loss = 4.0841e-03, PNorm = 112.6307, GNorm = 0.0904, lr_0 = 9.4918e-04
Loss = 3.5249e-03, PNorm = 112.6460, GNorm = 0.1409, lr_0 = 9.4916e-04
Validation auc = 0.676116
Epoch 1024
Validation auc = 0.668811
Epoch 1025
Validation auc = 0.659216
Epoch 1026
Validation auc = 0.652183
Epoch 1027
Validation auc = 0.646677
Epoch 1028
Loss = 2.5385e-03, PNorm = 112.7671, GNorm = 0.0518, lr_0 = 9.4894e-04
Validation auc = 0.644060
Epoch 1029
Validation auc = 0.642316
Epoch 1030
Validation auc = 0.642588
Epoch 1031
Validation auc = 0.642261
Epoch 1032
Validation auc = 0.643352
Epoch 1033
Loss = 2.0760e-03, PNorm = 112.8284, GNorm = 0.0465, lr_0 = 9.4869e-04
Validation auc = 0.654364
Epoch 1034
Validation auc = 0.679442
Epoch 1035
Validation auc = 0.689582
Epoch 1036
Validation auc = 0.700322
Epoch 1037
Loss = 4.4024e-02, PNorm = 113.1361, GNorm = 1.9662, lr_0 = 9.4847e-04
Loss = 1.0501e-02, PNorm = 113.1658, GNorm = 0.3251, lr_0 = 9.4845e-04
Validation auc = 0.698523
Epoch 1038
Validation auc = 0.681895
Epoch 1039
Validation auc = 0.667394
Epoch 1040
Validation auc = 0.643570
Epoch 1041
Validation auc = 0.629286
Epoch 1042
Loss = 4.6133e-03, PNorm = 113.4837, GNorm = 0.0754, lr_0 = 9.4823e-04
Validation auc = 0.612768
Epoch 1043
Validation auc = 0.615385
Epoch 1044
Validation auc = 0.613258
Epoch 1045
Validation auc = 0.611296
Epoch 1046
Validation auc = 0.620346
Epoch 1047
Loss = 2.1749e-03, PNorm = 113.9537, GNorm = 0.0401, lr_0 = 9.4798e-04
Validation auc = 0.629068
Epoch 1048
Validation auc = 0.615494
Epoch 1049
Validation auc = 0.612168
Epoch 1050
Validation auc = 0.607861
Epoch 1051
Loss = 1.5388e-01, PNorm = 114.2413, GNorm = 2.5412, lr_0 = 9.4776e-04
Loss = 7.6302e-03, PNorm = 114.2777, GNorm = 0.6615, lr_0 = 9.4775e-04
Validation auc = 0.616311
Epoch 1052
Validation auc = 0.635610
Epoch 1053
Validation auc = 0.658780
Epoch 1054
Validation auc = 0.656490
Epoch 1055
Validation auc = 0.663414
Epoch 1056
Loss = 3.6196e-02, PNorm = 115.0408, GNorm = 1.0378, lr_0 = 9.4751e-04
Loss = 3.1175e-02, PNorm = 115.0992, GNorm = 1.0951, lr_0 = 9.4749e-04
Validation auc = 0.676825
Epoch 1057
Validation auc = 0.663141
Epoch 1058
Validation auc = 0.648694
Epoch 1059
Validation auc = 0.657526
Epoch 1060
Validation auc = 0.657308
Epoch 1061
Loss = 6.3652e-03, PNorm = 115.6631, GNorm = 0.1213, lr_0 = 9.4728e-04
Validation auc = 0.656817
Epoch 1062
Validation auc = 0.659107
Epoch 1063
Validation auc = 0.660743
Epoch 1064
Validation auc = 0.664722
Epoch 1065
Validation auc = 0.665867
Epoch 1066
Loss = 1.8017e-03, PNorm = 115.9606, GNorm = 0.0314, lr_0 = 9.4702e-04
Validation auc = 0.666031
Epoch 1067
Validation auc = 0.658398
Epoch 1068
Validation auc = 0.654855
Epoch 1069
Validation auc = 0.663087
Epoch 1070
Loss = 1.2054e-02, PNorm = 116.1314, GNorm = 0.0284, lr_0 = 9.4681e-04
Loss = 1.2599e-02, PNorm = 116.1501, GNorm = 0.5648, lr_0 = 9.4679e-04
Validation auc = 0.666739
Epoch 1071
Validation auc = 0.667394
Epoch 1072
Validation auc = 0.667394
Epoch 1073
Validation auc = 0.665922
Epoch 1074
Validation auc = 0.664450
Epoch 1075
Loss = 4.0374e-03, PNorm = 116.3125, GNorm = 0.1079, lr_0 = 9.4657e-04
Validation auc = 0.662487
Epoch 1076
Validation auc = 0.655291
Epoch 1077
Validation auc = 0.658889
Epoch 1078
Validation auc = 0.684348
Epoch 1079
Validation auc = 0.702448
Epoch 1080
Loss = 1.3826e-03, PNorm = 116.4047, GNorm = 0.0320, lr_0 = 9.4632e-04
Validation auc = 0.712915
Epoch 1081
Validation auc = 0.718803
Epoch 1082
Validation auc = 0.720820
Epoch 1083
Validation auc = 0.713242
Epoch 1084
Loss = 6.8638e-03, PNorm = 116.4914, GNorm = 0.2473, lr_0 = 9.4610e-04
Loss = 2.1765e-03, PNorm = 116.4998, GNorm = 0.0468, lr_0 = 9.4608e-04
Validation auc = 0.701303
Epoch 1085
Validation auc = 0.693562
Epoch 1086
Validation auc = 0.693180
Epoch 1087
Validation auc = 0.695252
Epoch 1088
Validation auc = 0.694052
Epoch 1089
Loss = 6.5873e-03, PNorm = 116.6828, GNorm = 0.3517, lr_0 = 9.4585e-04
Loss = 9.4757e-05, PNorm = 116.6929, GNorm = 0.0044, lr_0 = 9.4583e-04
Validation auc = 0.693616
Epoch 1090
Validation auc = 0.693125
Epoch 1091
Validation auc = 0.692689
Epoch 1092
Validation auc = 0.690182
Epoch 1093
Validation auc = 0.699122
Epoch 1094
Loss = 1.8005e-02, PNorm = 116.8230, GNorm = 0.5427, lr_0 = 9.4561e-04
Validation auc = 0.707790
Epoch 1095
Validation auc = 0.708499
Epoch 1096
Validation auc = 0.709371
Epoch 1097
Validation auc = 0.715096
Epoch 1098
Validation auc = 0.718040
Epoch 1099
Loss = 1.5025e-02, PNorm = 117.0304, GNorm = 0.7404, lr_0 = 9.4536e-04
Validation auc = 0.723382
Epoch 1100
Validation auc = 0.726054
Epoch 1101
Validation auc = 0.726435
Epoch 1102
Validation auc = 0.721093
Epoch 1103
Loss = 4.1989e-03, PNorm = 117.1287, GNorm = 0.1858, lr_0 = 9.4515e-04
Loss = 7.5474e-04, PNorm = 117.1348, GNorm = 0.0289, lr_0 = 9.4513e-04
Validation auc = 0.714278
Epoch 1104
Validation auc = 0.707845
Epoch 1105
Validation auc = 0.698577
Epoch 1106
Validation auc = 0.690945
Epoch 1107
Validation auc = 0.685657
Epoch 1108
Loss = 2.2628e-03, PNorm = 117.3007, GNorm = 0.0293, lr_0 = 9.4489e-04
Validation auc = 0.681241
Epoch 1109
Validation auc = 0.679932
Epoch 1110
Validation auc = 0.675080
Epoch 1111
Validation auc = 0.671046
Epoch 1112
Validation auc = 0.668266
Epoch 1113
Loss = 1.0274e-03, PNorm = 117.4664, GNorm = 0.0149, lr_0 = 9.4466e-04
Validation auc = 0.664831
Epoch 1114
Validation auc = 0.662105
Epoch 1115
Validation auc = 0.661015
Epoch 1116
Validation auc = 0.660688
Epoch 1117
Loss = 3.9113e-03, PNorm = 117.5382, GNorm = 0.1444, lr_0 = 9.4444e-04
Loss = 5.3530e-04, PNorm = 117.5418, GNorm = 0.0159, lr_0 = 9.4443e-04
Validation auc = 0.658071
Epoch 1118
Validation auc = 0.656926
Epoch 1119
Validation auc = 0.656163
Epoch 1120
Validation auc = 0.655127
Epoch 1121
Validation auc = 0.646623
Epoch 1122
Loss = 1.3849e-03, PNorm = 117.5699, GNorm = 0.0271, lr_0 = 9.4419e-04
Loss = 2.1309e-03, PNorm = 117.5714, GNorm = 0.0395, lr_0 = 9.4417e-04
Validation auc = 0.637682
Epoch 1123
Validation auc = 0.649021
Epoch 1124
Validation auc = 0.659979
Epoch 1125
Validation auc = 0.664395
Epoch 1126
Validation auc = 0.662978
Epoch 1127
Loss = 1.6084e-03, PNorm = 117.6306, GNorm = 0.0255, lr_0 = 9.4396e-04
Validation auc = 0.661015
Epoch 1128
Validation auc = 0.659543
Epoch 1129
Validation auc = 0.659707
Epoch 1130
Validation auc = 0.658725
Epoch 1131
Validation auc = 0.657199
Epoch 1132
Loss = 5.0134e-03, PNorm = 117.6987, GNorm = 0.0994, lr_0 = 9.4371e-04
Validation auc = 0.655345
Epoch 1133
Validation auc = 0.653219
Epoch 1134
Validation auc = 0.650003
Epoch 1135
Validation auc = 0.647659
Epoch 1136
Loss = 9.0735e-04, PNorm = 117.7324, GNorm = 0.0177, lr_0 = 9.4349e-04
Loss = 8.1132e-05, PNorm = 117.7340, GNorm = 0.0026, lr_0 = 9.4347e-04
Validation auc = 0.646623
Epoch 1137
Validation auc = 0.643570
Epoch 1138
Validation auc = 0.635992
Epoch 1139
Validation auc = 0.632067
Epoch 1140
Validation auc = 0.628850
Epoch 1141
Loss = 8.0734e-02, PNorm = 117.7641, GNorm = 1.9556, lr_0 = 9.4324e-04
Validation auc = 0.632339
Epoch 1142
Validation auc = 0.639372
Epoch 1143
Validation auc = 0.642534
Epoch 1144
Validation auc = 0.647222
Epoch 1145
Validation auc = 0.665976
Epoch 1146
Loss = 1.9907e-03, PNorm = 117.9074, GNorm = 0.1593, lr_0 = 9.4300e-04
Validation auc = 0.684021
Epoch 1147
Validation auc = 0.694652
Epoch 1148
Validation auc = 0.699776
Epoch 1149
Validation auc = 0.701794
Epoch 1150
Loss = 4.2076e-03, PNorm = 118.0369, GNorm = 0.1408, lr_0 = 9.4279e-04
Loss = 1.7879e-03, PNorm = 118.0439, GNorm = 0.1382, lr_0 = 9.4277e-04
Validation auc = 0.702884
Epoch 1151
Validation auc = 0.703974
Epoch 1152
Validation auc = 0.703484
Epoch 1153
Validation auc = 0.702666
Epoch 1154
Validation auc = 0.702448
Epoch 1155
Loss = 5.2166e-02, PNorm = 118.1046, GNorm = 1.1593, lr_0 = 9.4253e-04
Loss = 2.1160e-03, PNorm = 118.1052, GNorm = 0.0749, lr_0 = 9.4252e-04
Validation auc = 0.703047
Epoch 1156
Validation auc = 0.702829
Epoch 1157
Validation auc = 0.704247
Epoch 1158
Validation auc = 0.705337
Epoch 1159
Validation auc = 0.700158
Epoch 1160
Loss = 3.5920e-03, PNorm = 118.1587, GNorm = 0.0900, lr_0 = 9.4230e-04
Validation auc = 0.695361
Epoch 1161
Validation auc = 0.691872
Epoch 1162
Validation auc = 0.693125
Epoch 1163
Validation auc = 0.694216
Epoch 1164
Validation auc = 0.693234
Epoch 1165
Loss = 1.7100e-03, PNorm = 118.2097, GNorm = 0.0344, lr_0 = 9.4205e-04
Validation auc = 0.692035
Epoch 1166
Validation auc = 0.689800
Epoch 1167
Validation auc = 0.688764
Epoch 1168
Validation auc = 0.685984
Epoch 1169
Loss = 9.6500e-04, PNorm = 118.2387, GNorm = 0.0334, lr_0 = 9.4183e-04
Loss = 1.3105e-01, PNorm = 118.2447, GNorm = 5.3729, lr_0 = 9.4182e-04
Validation auc = 0.689527
Epoch 1170
Validation auc = 0.695088
Epoch 1171
Validation auc = 0.690018
Epoch 1172
Validation auc = 0.683749
Epoch 1173
Validation auc = 0.676280
Epoch 1174
Loss = 8.6123e-03, PNorm = 118.3493, GNorm = 0.1323, lr_0 = 9.4158e-04
Validation auc = 0.673772
Epoch 1175
Validation auc = 0.669356
Epoch 1176
Validation auc = 0.666194
Epoch 1177
Validation auc = 0.664940
Epoch 1178
Validation auc = 0.664504
Epoch 1179
Loss = 4.9943e-02, PNorm = 118.4096, GNorm = 1.5640, lr_0 = 9.4135e-04
Validation auc = 0.665431
Epoch 1180
Validation auc = 0.662105
Epoch 1181
Validation auc = 0.661451
Epoch 1182
Validation auc = 0.660906
Epoch 1183
Loss = 1.4108e-02, PNorm = 118.5081, GNorm = 0.0287, lr_0 = 9.4112e-04
Validation auc = 0.634411
Epoch 1184
Validation auc = 0.609333
Epoch 1185
Validation auc = 0.710516
Epoch 1186
Validation auc = 0.726435
Epoch 1187
Validation auc = 0.730524
Epoch 1188
Loss = 5.4949e-03, PNorm = 118.6047, GNorm = 0.1881, lr_0 = 9.4088e-04
Loss = 7.9443e-05, PNorm = 118.6125, GNorm = 0.0021, lr_0 = 9.4087e-04
Validation auc = 0.730524
Epoch 1189
Validation auc = 0.728016
Epoch 1190
Validation auc = 0.729106
Epoch 1191
Validation auc = 0.731778
Epoch 1192
Validation auc = 0.716131
Epoch 1193
Loss = 2.6013e-03, PNorm = 118.7204, GNorm = 0.1136, lr_0 = 9.4065e-04
Validation auc = 0.698305
Epoch 1194
Validation auc = 0.694434
Epoch 1195
Validation auc = 0.695633
Epoch 1196
Validation auc = 0.684566
Epoch 1197
Validation auc = 0.677643
Epoch 1198
Loss = 2.8210e-03, PNorm = 118.9273, GNorm = 0.0889, lr_0 = 9.4040e-04
Validation auc = 0.674644
Epoch 1199
Validation auc = 0.670446
Epoch 1200
Validation auc = 0.670283
Epoch 1201
Validation auc = 0.668266
Epoch 1202
Loss = 1.2413e-02, PNorm = 119.0554, GNorm = 0.2038, lr_0 = 9.4018e-04
Loss = 1.2016e-03, PNorm = 119.0630, GNorm = 0.0393, lr_0 = 9.4016e-04
Validation auc = 0.664504
Epoch 1203
Validation auc = 0.662814
Epoch 1204
Validation auc = 0.662487
Epoch 1205
Validation auc = 0.665049
Epoch 1206
Validation auc = 0.671646
Epoch 1207
Loss = 1.3459e-03, PNorm = 119.1446, GNorm = 0.0444, lr_0 = 9.3993e-04
Loss = 1.2397e-02, PNorm = 119.1540, GNorm = 0.6996, lr_0 = 9.3991e-04
Validation auc = 0.685766
Epoch 1208
Validation auc = 0.687020
Epoch 1209
Validation auc = 0.683640
Epoch 1210
Validation auc = 0.681895
Epoch 1211
Validation auc = 0.682549
Epoch 1212
Loss = 6.4444e-04, PNorm = 119.3154, GNorm = 0.0124, lr_0 = 9.3970e-04
Validation auc = 0.682549
Epoch 1213
Validation auc = 0.676879
Epoch 1214
Validation auc = 0.672027
Epoch 1215
Validation auc = 0.671155
Epoch 1216
Loss = 9.1529e-04, PNorm = 119.4218, GNorm = 0.0550, lr_0 = 9.3946e-04
Validation auc = 0.670446
Epoch 1217
Validation auc = 0.672845
Epoch 1218
Validation auc = 0.675626
Epoch 1219
Validation auc = 0.677861
Epoch 1220
Validation auc = 0.679823
Epoch 1221
Loss = 1.9776e-04, PNorm = 119.4584, GNorm = 0.0023, lr_0 = 9.3923e-04
Loss = 1.4715e-04, PNorm = 119.4600, GNorm = 0.0049, lr_0 = 9.3922e-04
Validation auc = 0.681786
Epoch 1222
Validation auc = 0.683040
Epoch 1223
Validation auc = 0.683967
Epoch 1224
Validation auc = 0.684512
Epoch 1225
Validation auc = 0.683967
Epoch 1226
Loss = 2.9746e-04, PNorm = 119.4716, GNorm = 0.0039, lr_0 = 9.3900e-04
Validation auc = 0.683531
Epoch 1227
Validation auc = 0.683531
Epoch 1228
Validation auc = 0.683912
Epoch 1229
Validation auc = 0.683312
Epoch 1230
Validation auc = 0.683258
Epoch 1231
Loss = 2.9679e-04, PNorm = 119.4831, GNorm = 0.0090, lr_0 = 9.3875e-04
Validation auc = 0.682004
Epoch 1232
Validation auc = 0.682059
Epoch 1233
Validation auc = 0.692962
Epoch 1234
Validation auc = 0.706755
Epoch 1235
Loss = 2.0406e-03, PNorm = 119.6777, GNorm = 0.1067, lr_0 = 9.3853e-04
Loss = 5.0437e-04, PNorm = 119.6978, GNorm = 0.0120, lr_0 = 9.3852e-04
Validation auc = 0.714387
Epoch 1236
Validation auc = 0.713460
Epoch 1237
Validation auc = 0.706428
Epoch 1238
Validation auc = 0.705719
Epoch 1239
Validation auc = 0.708608
Epoch 1240
Loss = 3.9173e-03, PNorm = 119.8911, GNorm = 0.1344, lr_0 = 9.3828e-04
Loss = 1.5277e-03, PNorm = 119.9039, GNorm = 0.0853, lr_0 = 9.3827e-04
Validation auc = 0.709917
Epoch 1241
Validation auc = 0.711770
Epoch 1242
Validation auc = 0.712697
Epoch 1243
Validation auc = 0.716131
Epoch 1244
Validation auc = 0.717385
Epoch 1245
Loss = 1.4428e-02, PNorm = 120.0072, GNorm = 0.3875, lr_0 = 9.3805e-04
Validation auc = 0.717931
Epoch 1246
Validation auc = 0.720438
Epoch 1247
Validation auc = 0.722183
Epoch 1248
Validation auc = 0.723709
Epoch 1249
Loss = 9.2104e-04, PNorm = 120.0500, GNorm = 0.0197, lr_0 = 9.3782e-04
Validation auc = 0.724745
Epoch 1250
Validation auc = 0.725508
Epoch 1251
Validation auc = 0.726708
Epoch 1252
Validation auc = 0.727853
Epoch 1253
Validation auc = 0.728834
Epoch 1254
Loss = 7.5861e-04, PNorm = 120.0818, GNorm = 0.0209, lr_0 = 9.3758e-04
Loss = 3.7079e-04, PNorm = 120.0835, GNorm = 0.0141, lr_0 = 9.3757e-04
Validation auc = 0.729216
Epoch 1255
Validation auc = 0.729815
Epoch 1256
Validation auc = 0.729924
Epoch 1257
Validation auc = 0.727798
Epoch 1258
Validation auc = 0.720874
Epoch 1259
Loss = 6.6087e-04, PNorm = 120.1027, GNorm = 0.0098, lr_0 = 9.3735e-04
Validation auc = 0.710680
Epoch 1260
Validation auc = 0.702557
Epoch 1261
Validation auc = 0.695470
Epoch 1262
Validation auc = 0.691544
Epoch 1263
Validation auc = 0.693016
Epoch 1264
Loss = 2.2738e-03, PNorm = 120.1373, GNorm = 0.0582, lr_0 = 9.3710e-04
Validation auc = 0.693344
Epoch 1265
Validation auc = 0.692907
Epoch 1266
Validation auc = 0.691981
Epoch 1267
Validation auc = 0.690836
Epoch 1268
Loss = 2.1095e-03, PNorm = 120.1768, GNorm = 0.0124, lr_0 = 9.3689e-04
Loss = 2.9193e-04, PNorm = 120.1792, GNorm = 0.0107, lr_0 = 9.3687e-04
Validation auc = 0.690400
Epoch 1269
Validation auc = 0.689309
Epoch 1270
Validation auc = 0.688546
Epoch 1271
Validation auc = 0.688164
Epoch 1272
Validation auc = 0.687129
Epoch 1273
Loss = 2.3017e-04, PNorm = 120.2030, GNorm = 0.0020, lr_0 = 9.3664e-04
Loss = 4.8149e-04, PNorm = 120.2043, GNorm = 0.0115, lr_0 = 9.3662e-04
Validation auc = 0.686583
Epoch 1274
Validation auc = 0.686256
Epoch 1275
Validation auc = 0.685929
Epoch 1276
Validation auc = 0.684839
Epoch 1277
Validation auc = 0.684185
Epoch 1278
Loss = 1.3945e-04, PNorm = 120.2133, GNorm = 0.0025, lr_0 = 9.3641e-04
Validation auc = 0.684403
Epoch 1279
Validation auc = 0.684239
Epoch 1280
Validation auc = 0.683912
Epoch 1281
Validation auc = 0.683640
Epoch 1282
Validation auc = 0.683476
Epoch 1283
Loss = 2.6098e-04, PNorm = 120.2214, GNorm = 0.0082, lr_0 = 9.3616e-04
Validation auc = 0.683367
Epoch 1284
Validation auc = 0.683040
Epoch 1285
Validation auc = 0.682931
Epoch 1286
Validation auc = 0.682985
Epoch 1287
Loss = 3.4726e-02, PNorm = 120.2265, GNorm = 0.0026, lr_0 = 9.3594e-04
Loss = 1.1205e-04, PNorm = 120.2272, GNorm = 0.0029, lr_0 = 9.3592e-04
Validation auc = 0.682331
Epoch 1288
Validation auc = 0.681950
Epoch 1289
Validation auc = 0.682113
Epoch 1290
Validation auc = 0.682386
Epoch 1291
Validation auc = 0.683912
Epoch 1292
Loss = 1.4827e-03, PNorm = 120.2468, GNorm = 0.0699, lr_0 = 9.3571e-04
Validation auc = 0.686256
Epoch 1293
Validation auc = 0.687837
Epoch 1294
Validation auc = 0.688982
Epoch 1295
Validation auc = 0.690018
Epoch 1296
Validation auc = 0.690509
Epoch 1297
Loss = 1.9728e-04, PNorm = 120.2652, GNorm = 0.0048, lr_0 = 9.3546e-04
Validation auc = 0.690073
Epoch 1298
Validation auc = 0.690400
Epoch 1299
Validation auc = 0.690781
Epoch 1300
Validation auc = 0.690781
Epoch 1301
Loss = 1.6572e-04, PNorm = 120.2704, GNorm = 0.0040, lr_0 = 9.3524e-04
Loss = 1.2293e-03, PNorm = 120.2708, GNorm = 0.0266, lr_0 = 9.3523e-04
Validation auc = 0.691108
Epoch 1302
Validation auc = 0.690727
Epoch 1303
Validation auc = 0.689963
Epoch 1304
Validation auc = 0.689200
Epoch 1305
Validation auc = 0.688601
Epoch 1306
Loss = 4.5474e-04, PNorm = 120.2730, GNorm = 0.0036, lr_0 = 9.3499e-04
Loss = 1.0889e-04, PNorm = 120.2736, GNorm = 0.0054, lr_0 = 9.3498e-04
Validation auc = 0.688273
Epoch 1307
Validation auc = 0.687946
Epoch 1308
Validation auc = 0.687674
Epoch 1309
Validation auc = 0.688164
Epoch 1310
Validation auc = 0.688601
Epoch 1311
Loss = 3.6279e-04, PNorm = 120.2826, GNorm = 0.0082, lr_0 = 9.3476e-04
Validation auc = 0.688164
Epoch 1312
Validation auc = 0.688492
Epoch 1313
Validation auc = 0.688764
Epoch 1314
Validation auc = 0.681840
Epoch 1315
Validation auc = 0.674753
Epoch 1316
Loss = 1.6206e-03, PNorm = 120.2695, GNorm = 0.0706, lr_0 = 9.3451e-04
Validation auc = 0.679278
Epoch 1317
Validation auc = 0.684512
Epoch 1318
Validation auc = 0.692199
Epoch 1319
Validation auc = 0.698850
Epoch 1320
Loss = 3.6865e-02, PNorm = 120.2938, GNorm = 0.0104, lr_0 = 9.3430e-04
Loss = 4.7322e-05, PNorm = 120.2956, GNorm = 0.0019, lr_0 = 9.3428e-04
Validation auc = 0.704792
Epoch 1321
Validation auc = 0.708608
Epoch 1322
Validation auc = 0.711116
Epoch 1323
Validation auc = 0.709699
Epoch 1324
Validation auc = 0.707191
Epoch 1325
Loss = 2.6232e-03, PNorm = 120.3211, GNorm = 0.0825, lr_0 = 9.3407e-04
Validation auc = 0.704301
Epoch 1326
Validation auc = 0.701794
Epoch 1327
Validation auc = 0.699340
Epoch 1328
Validation auc = 0.696396
Epoch 1329
Validation auc = 0.694379
Epoch 1330
Loss = 2.2099e-04, PNorm = 120.3405, GNorm = 0.0069, lr_0 = 9.3382e-04
Validation auc = 0.693125
Epoch 1331
Validation auc = 0.691981
Epoch 1332
Validation auc = 0.691272
Epoch 1333
Validation auc = 0.690509
Epoch 1334
Loss = 1.4000e-04, PNorm = 120.3491, GNorm = 0.0016, lr_0 = 9.3360e-04
Loss = 2.1408e-04, PNorm = 120.3496, GNorm = 0.0051, lr_0 = 9.3359e-04
Validation auc = 0.689473
Epoch 1335
Validation auc = 0.688546
Epoch 1336
Validation auc = 0.689963
Epoch 1337
Validation auc = 0.691653
Epoch 1338
Validation auc = 0.693180
Epoch 1339
Loss = 2.7765e-02, PNorm = 120.3525, GNorm = 0.9160, lr_0 = 9.3336e-04
Loss = 6.8067e-03, PNorm = 120.3546, GNorm = 0.2324, lr_0 = 9.3334e-04
Validation auc = 0.691381
Epoch 1340
Validation auc = 0.688382
Epoch 1341
Validation auc = 0.686202
Epoch 1342
Validation auc = 0.684839
Epoch 1343
Validation auc = 0.683203
Epoch 1344
Loss = 1.1144e-03, PNorm = 120.3781, GNorm = 0.0203, lr_0 = 9.3312e-04
Validation auc = 0.682113
Epoch 1345
Validation auc = 0.680859
Epoch 1346
Validation auc = 0.679878
Epoch 1347
Validation auc = 0.679115
Epoch 1348
Validation auc = 0.678624
Epoch 1349
Loss = 2.0992e-03, PNorm = 120.3949, GNorm = 0.0568, lr_0 = 9.3288e-04
Validation auc = 0.677588
Epoch 1350
Validation auc = 0.676825
Epoch 1351
Validation auc = 0.675898
Epoch 1352
Validation auc = 0.675244
Epoch 1353
Loss = 3.0512e-04, PNorm = 120.4026, GNorm = 0.0039, lr_0 = 9.3266e-04
Loss = 7.4872e-05, PNorm = 120.4031, GNorm = 0.0029, lr_0 = 9.3264e-04
Validation auc = 0.674808
Epoch 1354
Validation auc = 0.674372
Epoch 1355
Validation auc = 0.673936
Epoch 1356
Validation auc = 0.673772
Epoch 1357
Validation auc = 0.673554
Epoch 1358
Loss = 2.2599e-04, PNorm = 120.4080, GNorm = 0.0051, lr_0 = 9.3241e-04
Validation auc = 0.673227
Epoch 1359
Validation auc = 0.672845
Epoch 1360
Validation auc = 0.672464
Epoch 1361
Validation auc = 0.672355
Epoch 1362
Validation auc = 0.672082
Epoch 1363
Loss = 1.9966e-04, PNorm = 120.4116, GNorm = 0.0040, lr_0 = 9.3218e-04
Validation auc = 0.672082
Epoch 1364
Validation auc = 0.671918
Epoch 1365
Validation auc = 0.671809
Epoch 1366
Validation auc = 0.671809
Epoch 1367
Loss = 1.4047e-04, PNorm = 120.4138, GNorm = 0.0005, lr_0 = 9.3197e-04
Loss = 1.8080e-06, PNorm = 120.4140, GNorm = 0.0001, lr_0 = 9.3195e-04
Validation auc = 0.671809
Epoch 1368
Validation auc = 0.671700
Epoch 1369
Validation auc = 0.671755
Epoch 1370
Validation auc = 0.671918
Epoch 1371
Validation auc = 0.671973
Epoch 1372
Loss = 6.9937e-05, PNorm = 120.4154, GNorm = 0.0017, lr_0 = 9.3172e-04
Loss = 2.8610e-06, PNorm = 120.4155, GNorm = 0.0001, lr_0 = 9.3170e-04
Validation auc = 0.672464
Epoch 1373
Validation auc = 0.672573
Epoch 1374
Validation auc = 0.672627
Epoch 1375
Validation auc = 0.672627
Epoch 1376
Validation auc = 0.672791
Epoch 1377
Loss = 5.6569e-05, PNorm = 120.4170, GNorm = 0.0012, lr_0 = 9.3149e-04
Validation auc = 0.677534
Epoch 1378
Validation auc = 0.682440
Epoch 1379
Validation auc = 0.687565
Epoch 1380
Validation auc = 0.695797
Epoch 1381
Validation auc = 0.700267
Epoch 1382
Loss = 3.6081e-04, PNorm = 120.4180, GNorm = 0.0101, lr_0 = 9.3124e-04
Validation auc = 0.702448
Epoch 1383
Validation auc = 0.702339
Epoch 1384
Validation auc = 0.701466
Epoch 1385
Validation auc = 0.699449
Epoch 1386
Loss = 4.9218e-04, PNorm = 120.4481, GNorm = 0.0288, lr_0 = 9.3102e-04
Loss = 1.3374e-04, PNorm = 120.4502, GNorm = 0.0066, lr_0 = 9.3101e-04
Validation auc = 0.697541
Epoch 1387
Validation auc = 0.696015
Epoch 1388
Validation auc = 0.695361
Epoch 1389
Validation auc = 0.694870
Epoch 1390
Validation auc = 0.694270
Epoch 1391
Loss = 1.2053e-04, PNorm = 120.4693, GNorm = 0.0012, lr_0 = 9.3078e-04
Validation auc = 0.693616
Epoch 1392
Validation auc = 0.692635
Epoch 1393
Validation auc = 0.692308
Epoch 1394
Validation auc = 0.692144
Epoch 1395
Validation auc = 0.691817
Epoch 1396
Loss = 6.7568e-05, PNorm = 120.4765, GNorm = 0.0012, lr_0 = 9.3055e-04
Validation auc = 0.691381
Epoch 1397
Validation auc = 0.690836
Epoch 1398
Validation auc = 0.690727
Epoch 1399
Validation auc = 0.689582
Epoch 1400
Loss = 8.5186e-05, PNorm = 120.4823, GNorm = 0.0016, lr_0 = 9.3033e-04
Loss = 2.6325e-05, PNorm = 120.4829, GNorm = 0.0008, lr_0 = 9.3032e-04
Validation auc = 0.688873
Epoch 1401
Validation auc = 0.688164
Epoch 1402
Validation auc = 0.687783
Epoch 1403
Validation auc = 0.687456
Epoch 1404
Validation auc = 0.686911
Epoch 1405
Loss = 8.9416e-05, PNorm = 120.4897, GNorm = 0.0024, lr_0 = 9.3008e-04
Loss = 2.2967e-05, PNorm = 120.4900, GNorm = 0.0008, lr_0 = 9.3007e-04
Validation auc = 0.686802
Epoch 1406
Validation auc = 0.686692
Epoch 1407
Validation auc = 0.686365
Epoch 1408
Validation auc = 0.686311
Epoch 1409
Validation auc = 0.686202
Epoch 1410
Loss = 3.8263e-05, PNorm = 120.4940, GNorm = 0.0009, lr_0 = 9.2985e-04
Validation auc = 0.685875
Epoch 1411
Validation auc = 0.685766
Epoch 1412
Validation auc = 0.685711
Epoch 1413
Validation auc = 0.685439
Epoch 1414
Validation auc = 0.685166
Epoch 1415
Loss = 6.0540e-04, PNorm = 120.4981, GNorm = 0.0178, lr_0 = 9.2961e-04
Validation auc = 0.685221
Epoch 1416
Validation auc = 0.685493
Epoch 1417
Validation auc = 0.685493
Epoch 1418
Validation auc = 0.685766
Epoch 1419
Loss = 8.7194e-05, PNorm = 120.4964, GNorm = 0.0020, lr_0 = 9.2939e-04
Loss = 6.1392e-06, PNorm = 120.4965, GNorm = 0.0002, lr_0 = 9.2938e-04
Validation auc = 0.686474
Epoch 1420
Validation auc = 0.686529
Epoch 1421
Validation auc = 0.686420
Epoch 1422
Validation auc = 0.686311
Epoch 1423
Validation auc = 0.686202
Epoch 1424
Loss = 8.2472e-05, PNorm = 120.4992, GNorm = 0.0016, lr_0 = 9.2914e-04
Validation auc = 0.686202
Epoch 1425
Validation auc = 0.686147
Epoch 1426
Validation auc = 0.686147
Epoch 1427
Validation auc = 0.685820
Epoch 1428
Validation auc = 0.686583
Epoch 1429
Loss = 7.2331e-05, PNorm = 120.5031, GNorm = 0.0015, lr_0 = 9.2891e-04
Validation auc = 0.686583
Epoch 1430
Validation auc = 0.686965
Epoch 1431
Validation auc = 0.687020
Epoch 1432
Validation auc = 0.687129
Epoch 1433
Loss = 4.7263e-05, PNorm = 120.5070, GNorm = 0.0004, lr_0 = 9.2868e-04
Validation auc = 0.687292
Epoch 1434
Validation auc = 0.687401
Epoch 1435
Validation auc = 0.687292
Epoch 1436
Validation auc = 0.687238
Epoch 1437
Validation auc = 0.687238
Epoch 1438
Loss = 4.7138e-05, PNorm = 120.5106, GNorm = 0.0011, lr_0 = 9.2845e-04
Loss = 2.2768e-05, PNorm = 120.5108, GNorm = 0.0009, lr_0 = 9.2844e-04
Validation auc = 0.687129
Epoch 1439
Validation auc = 0.687020
Epoch 1440
Validation auc = 0.686911
Epoch 1441
Validation auc = 0.686747
Epoch 1442
Validation auc = 0.686420
Epoch 1443
Loss = 6.3243e-05, PNorm = 120.5155, GNorm = 0.0013, lr_0 = 9.2822e-04
Validation auc = 0.686093
Epoch 1444
Validation auc = 0.685820
Epoch 1445
Validation auc = 0.685766
Epoch 1446
Validation auc = 0.685657
Epoch 1447
Validation auc = 0.685548
Epoch 1448
Loss = 3.4085e-05, PNorm = 120.5212, GNorm = 0.0007, lr_0 = 9.2798e-04
Validation auc = 0.685275
Epoch 1449
Validation auc = 0.685275
Epoch 1450
Validation auc = 0.685111
Epoch 1451
Validation auc = 0.684784
Epoch 1452
Loss = 4.4911e-05, PNorm = 120.5237, GNorm = 0.0015, lr_0 = 9.2776e-04
Loss = 7.0958e-05, PNorm = 120.5241, GNorm = 0.0025, lr_0 = 9.2775e-04
Validation auc = 0.684621
Epoch 1453
Validation auc = 0.684076
Epoch 1454
Validation auc = 0.684076
Epoch 1455
Validation auc = 0.683694
Epoch 1456
Validation auc = 0.683858
Epoch 1457
Loss = 2.4878e-05, PNorm = 120.5276, GNorm = 0.0006, lr_0 = 9.2752e-04
Loss = 7.2320e-06, PNorm = 120.5277, GNorm = 0.0004, lr_0 = 9.2750e-04
Validation auc = 0.683967
Epoch 1458
Validation auc = 0.684185
Epoch 1459
Validation auc = 0.683967
Epoch 1460
Validation auc = 0.684239
Epoch 1461
Validation auc = 0.684239
Epoch 1462
Loss = 1.7132e-05, PNorm = 120.5303, GNorm = 0.0003, lr_0 = 9.2729e-04
Validation auc = 0.684348
Epoch 1463
Validation auc = 0.684512
Epoch 1464
Validation auc = 0.684348
Epoch 1465
Validation auc = 0.684403
Epoch 1466
Loss = 2.7715e-05, PNorm = 120.5327, GNorm = 0.0026, lr_0 = 9.2706e-04
Validation auc = 0.684784
Epoch 1467
Validation auc = 0.685166
Epoch 1468
Validation auc = 0.685384
Epoch 1469
Validation auc = 0.685384
Epoch 1470
Validation auc = 0.685275
Epoch 1471
Loss = 2.5674e-05, PNorm = 120.5358, GNorm = 0.0004, lr_0 = 9.2683e-04
Loss = 1.8596e-05, PNorm = 120.5361, GNorm = 0.0010, lr_0 = 9.2681e-04
Validation auc = 0.685166
Epoch 1472
Validation auc = 0.685275
Epoch 1473
Validation auc = 0.685384
Epoch 1474
Validation auc = 0.685493
Epoch 1475
Validation auc = 0.685766
Epoch 1476
Loss = 1.9093e-05, PNorm = 120.5389, GNorm = 0.0004, lr_0 = 9.2660e-04
Validation auc = 0.686038
Epoch 1477
Validation auc = 0.685984
Epoch 1478
Validation auc = 0.685875
Epoch 1479
Validation auc = 0.685875
Epoch 1480
Validation auc = 0.685929
Epoch 1481
Loss = 1.9780e-05, PNorm = 120.5425, GNorm = 0.0005, lr_0 = 9.2635e-04
Validation auc = 0.685929
Epoch 1482
Validation auc = 0.685875
Epoch 1483
Validation auc = 0.685766
Epoch 1484
Validation auc = 0.685929
Epoch 1485
Loss = 1.6619e-05, PNorm = 120.5444, GNorm = 0.0004, lr_0 = 9.2614e-04
Loss = 9.9341e-08, PNorm = 120.5445, GNorm = 0.0000, lr_0 = 9.2612e-04
Validation auc = 0.685929
Epoch 1486
Validation auc = 0.685929
Epoch 1487
Validation auc = 0.686583
Epoch 1488
Validation auc = 0.687892
Epoch 1489
Validation auc = 0.689636
Epoch 1490
Loss = 3.0241e-05, PNorm = 120.5424, GNorm = 0.0008, lr_0 = 9.2589e-04
Loss = 3.7750e-07, PNorm = 120.5425, GNorm = 0.0000, lr_0 = 9.2587e-04
Validation auc = 0.691163
Epoch 1491
Validation auc = 0.692035
Epoch 1492
Validation auc = 0.692308
Epoch 1493
Validation auc = 0.692362
Epoch 1494
Validation auc = 0.692689
Epoch 1495
Loss = 9.0609e-05, PNorm = 120.5439, GNorm = 0.0028, lr_0 = 9.2566e-04
Validation auc = 0.692580
Epoch 1496
Validation auc = 0.692580
Epoch 1497
Validation auc = 0.692635
Epoch 1498
Validation auc = 0.692471
Epoch 1499
Loss = 6.0970e-05, PNorm = 120.5458, GNorm = 0.0088, lr_0 = 9.2543e-04
Validation auc = 0.692907
Epoch 1500
Validation auc = 0.693344
Epoch 1501
Validation auc = 0.693725
Epoch 1502
Validation auc = 0.693671
Epoch 1503
Validation auc = 0.693834
Epoch 1504
Loss = 3.0384e-05, PNorm = 120.5482, GNorm = 0.0003, lr_0 = 9.2520e-04
Loss = 3.2105e-05, PNorm = 120.5484, GNorm = 0.0015, lr_0 = 9.2518e-04
Validation auc = 0.693780
Epoch 1505
Validation auc = 0.693616
Epoch 1506
Validation auc = 0.693562
Epoch 1507
Validation auc = 0.693453
Epoch 1508
Validation auc = 0.693398
Epoch 1509
Loss = 3.0121e-05, PNorm = 120.5507, GNorm = 0.0007, lr_0 = 9.2497e-04
Validation auc = 0.693234
Epoch 1510
Validation auc = 0.692962
Epoch 1511
Validation auc = 0.692580
Epoch 1512
Validation auc = 0.692144
Epoch 1513
Validation auc = 0.691926
Epoch 1514
Loss = 2.7720e-05, PNorm = 120.5540, GNorm = 0.0006, lr_0 = 9.2472e-04
Validation auc = 0.691981
Epoch 1515
Validation auc = 0.691817
Epoch 1516
Validation auc = 0.691926
Epoch 1517
Validation auc = 0.691926
Epoch 1518
Loss = 1.6009e-05, PNorm = 120.5561, GNorm = 0.0005, lr_0 = 9.2451e-04
Loss = 5.5642e-05, PNorm = 120.5563, GNorm = 0.0027, lr_0 = 9.2449e-04
Validation auc = 0.691708
Epoch 1519
Validation auc = 0.691490
Epoch 1520
Validation auc = 0.691926
Epoch 1521
Validation auc = 0.692035
Epoch 1522
Validation auc = 0.691981
Epoch 1523
Loss = 2.1936e-05, PNorm = 120.5582, GNorm = 0.0007, lr_0 = 9.2427e-04
Loss = 4.6094e-06, PNorm = 120.5584, GNorm = 0.0003, lr_0 = 9.2425e-04
Validation auc = 0.692308
Epoch 1524
Validation auc = 0.692144
Epoch 1525
Validation auc = 0.691926
Epoch 1526
Validation auc = 0.691817
Epoch 1527
Validation auc = 0.693016
Epoch 1528
Loss = 9.0986e-05, PNorm = 120.5599, GNorm = 0.0039, lr_0 = 9.2404e-04
Validation auc = 0.694325
Epoch 1529
Validation auc = 0.694761
Epoch 1530
Validation auc = 0.695524
Epoch 1531
Validation auc = 0.695361
Epoch 1532
Validation auc = 0.695415
Epoch 1533
Loss = 1.4295e-05, PNorm = 120.5616, GNorm = 0.0004, lr_0 = 9.2379e-04
Validation auc = 0.695470
Epoch 1534
Validation auc = 0.695524
Epoch 1535
Validation auc = 0.695470
Epoch 1536
Validation auc = 0.695688
Epoch 1537
Loss = 3.9350e-05, PNorm = 120.5643, GNorm = 0.0019, lr_0 = 9.2358e-04
Loss = 3.2164e-05, PNorm = 120.5646, GNorm = 0.0010, lr_0 = 9.2356e-04
Validation auc = 0.696124
Epoch 1538
Validation auc = 0.696996
Epoch 1539
Validation auc = 0.697160
Epoch 1540
Validation auc = 0.697541
Epoch 1541
Validation auc = 0.697541
Epoch 1542
Loss = 4.9480e-05, PNorm = 120.5679, GNorm = 0.0011, lr_0 = 9.2335e-04
Validation auc = 0.697650
Epoch 1543
Validation auc = 0.697596
Epoch 1544
Validation auc = 0.697705
Epoch 1545
Validation auc = 0.697596
Epoch 1546
Validation auc = 0.697323
Epoch 1547
Loss = 2.7187e-05, PNorm = 120.5708, GNorm = 0.0007, lr_0 = 9.2310e-04
Validation auc = 0.697269
Epoch 1548
Validation auc = 0.697160
Epoch 1549
Validation auc = 0.696724
Epoch 1550
Validation auc = 0.696505
Epoch 1551
Loss = 2.4779e-05, PNorm = 120.5733, GNorm = 0.0006, lr_0 = 9.2289e-04
Loss = 1.3908e-07, PNorm = 120.5735, GNorm = 0.0000, lr_0 = 9.2287e-04
Validation auc = 0.696505
Epoch 1552
Validation auc = 0.696287
Epoch 1553
Validation auc = 0.696015
Epoch 1554
Validation auc = 0.695688
Epoch 1555
Validation auc = 0.695524
Epoch 1556
Loss = 1.3556e-05, PNorm = 120.5760, GNorm = 0.0004, lr_0 = 9.2264e-04
Loss = 9.2585e-05, PNorm = 120.5762, GNorm = 0.0037, lr_0 = 9.2263e-04
Validation auc = 0.694815
Epoch 1557
Validation auc = 0.694325
Epoch 1558
Validation auc = 0.694379
Epoch 1559
Validation auc = 0.694325
Epoch 1560
Validation auc = 0.694325
Epoch 1561
Loss = 1.5504e-05, PNorm = 120.5785, GNorm = 0.0004, lr_0 = 9.2242e-04
Validation auc = 0.693998
Epoch 1562
Validation auc = 0.693998
Epoch 1563
Validation auc = 0.693616
Epoch 1564
Validation auc = 0.693453
Epoch 1565
Validation auc = 0.693344
Epoch 1566
Loss = 7.4787e-06, PNorm = 120.5807, GNorm = 0.0002, lr_0 = 9.2217e-04
Validation auc = 0.693180
Epoch 1567
Validation auc = 0.692853
Epoch 1568
Validation auc = 0.692798
Epoch 1569
Validation auc = 0.692853
Epoch 1570
Loss = 1.2251e-05, PNorm = 120.5825, GNorm = 0.0002, lr_0 = 9.2196e-04
Loss = 1.7722e-05, PNorm = 120.5826, GNorm = 0.0005, lr_0 = 9.2194e-04
Validation auc = 0.692689
Epoch 1571
Validation auc = 0.692526
Epoch 1572
Validation auc = 0.692580
Epoch 1573
Validation auc = 0.692744
Epoch 1574
Validation auc = 0.692853
Epoch 1575
Loss = 9.7129e-06, PNorm = 120.5836, GNorm = 0.0002, lr_0 = 9.2173e-04
Validation auc = 0.692962
Epoch 1576
Validation auc = 0.692853
Epoch 1577
Validation auc = 0.692635
Epoch 1578
Validation auc = 0.692362
Epoch 1579
Validation auc = 0.692144
Epoch 1580
Loss = 8.3371e-06, PNorm = 120.5849, GNorm = 0.0003, lr_0 = 9.2148e-04
Validation auc = 0.692090
Epoch 1581
Validation auc = 0.692090
Epoch 1582
Validation auc = 0.692035
Epoch 1583
Validation auc = 0.691981
Epoch 1584
Loss = 5.7434e-04, PNorm = 120.5855, GNorm = 0.0489, lr_0 = 9.2127e-04
Loss = 7.9473e-07, PNorm = 120.5853, GNorm = 0.0000, lr_0 = 9.2125e-04
Validation auc = 0.692362
Epoch 1585
Validation auc = 0.693616
Epoch 1586
Validation auc = 0.693780
Epoch 1587
Validation auc = 0.693671
Epoch 1588
Validation auc = 0.693834
Epoch 1589
Loss = 1.8605e-05, PNorm = 120.5858, GNorm = 0.0004, lr_0 = 9.2103e-04
Loss = 1.9490e-05, PNorm = 120.5860, GNorm = 0.0006, lr_0 = 9.2101e-04
Validation auc = 0.693998
Epoch 1590
Validation auc = 0.693834
Epoch 1591
Validation auc = 0.693725
Epoch 1592
Validation auc = 0.693562
Epoch 1593
Validation auc = 0.693507
Epoch 1594
Loss = 1.7465e-05, PNorm = 120.5876, GNorm = 0.0005, lr_0 = 9.2080e-04
Validation auc = 0.693234
Epoch 1595
Validation auc = 0.693125
Epoch 1596
Validation auc = 0.693016
Epoch 1597
Validation auc = 0.692744
Epoch 1598
Validation auc = 0.692471
Epoch 1599
Loss = 1.4900e-05, PNorm = 120.5896, GNorm = 0.0005, lr_0 = 9.2055e-04
Validation auc = 0.692144
Epoch 1600
Validation auc = 0.691490
Epoch 1601
Validation auc = 0.691381
Epoch 1602
Validation auc = 0.691054
Epoch 1603
Loss = 1.1032e-05, PNorm = 120.5916, GNorm = 0.0004, lr_0 = 9.2034e-04
Loss = 2.7219e-06, PNorm = 120.5917, GNorm = 0.0001, lr_0 = 9.2032e-04
Validation auc = 0.690890
Epoch 1604
Validation auc = 0.690291
Epoch 1605
Validation auc = 0.690182
Epoch 1606
Validation auc = 0.689854
Epoch 1607
Validation auc = 0.689800
Epoch 1608
Loss = 1.4075e-05, PNorm = 120.5937, GNorm = 0.0008, lr_0 = 9.2010e-04
Validation auc = 0.689473
Epoch 1609
Validation auc = 0.689309
Epoch 1610
Validation auc = 0.689037
Epoch 1611
Validation auc = 0.688982
Epoch 1612
Validation auc = 0.688928
Epoch 1613
Loss = 1.4049e-05, PNorm = 120.5952, GNorm = 0.0004, lr_0 = 9.1987e-04
Validation auc = 0.689691
Epoch 1614
Validation auc = 0.691653
Epoch 1615
Validation auc = 0.692199
Epoch 1616
Validation auc = 0.692744
Epoch 1617
Loss = 1.5020e-05, PNorm = 120.5943, GNorm = 0.0006, lr_0 = 9.1966e-04
Loss = 2.1656e-06, PNorm = 120.5944, GNorm = 0.0002, lr_0 = 9.1964e-04
Validation auc = 0.693180
Epoch 1618
Validation auc = 0.693016
Epoch 1619
Validation auc = 0.692689
Epoch 1620
Validation auc = 0.692744
Epoch 1621
Validation auc = 0.692689
Epoch 1622
Loss = 1.8164e-05, PNorm = 120.5956, GNorm = 0.0008, lr_0 = 9.1941e-04
Loss = 2.6800e-05, PNorm = 120.5957, GNorm = 0.0013, lr_0 = 9.1939e-04
Validation auc = 0.692471
Epoch 1623
Validation auc = 0.692362
Epoch 1624
Validation auc = 0.692308
Epoch 1625
Validation auc = 0.692035
Epoch 1626
Validation auc = 0.691817
Epoch 1627
Loss = 8.1224e-06, PNorm = 120.5974, GNorm = 0.0005, lr_0 = 9.1918e-04
Validation auc = 0.691817
Epoch 1628
Validation auc = 0.691544
Epoch 1629
Validation auc = 0.691653
Epoch 1630
Validation auc = 0.691326
Epoch 1631
Validation auc = 0.691217
Epoch 1632
Loss = 1.0711e-05, PNorm = 120.5994, GNorm = 0.0003, lr_0 = 9.1894e-04
Validation auc = 0.690999
Epoch 1633
Validation auc = 0.690781
Epoch 1634
Validation auc = 0.690781
Epoch 1635
Validation auc = 0.690563
Epoch 1636
Loss = 5.9377e-06, PNorm = 120.6008, GNorm = 0.0002, lr_0 = 9.1873e-04
Loss = 5.5631e-07, PNorm = 120.6009, GNorm = 0.0000, lr_0 = 9.1871e-04
Validation auc = 0.690400
Epoch 1637
Validation auc = 0.690291
Epoch 1638
Validation auc = 0.690018
Epoch 1639
Validation auc = 0.689745
Epoch 1640
Validation auc = 0.689527
Epoch 1641
Loss = 9.0648e-06, PNorm = 120.6017, GNorm = 0.0008, lr_0 = 9.1848e-04
Validation auc = 0.689309
Epoch 1642
Validation auc = 0.688982
Epoch 1643
Validation auc = 0.688873
Epoch 1644
Validation auc = 0.688655
Epoch 1645
Validation auc = 0.688546
Epoch 1646
Loss = 6.0604e-06, PNorm = 120.6028, GNorm = 0.0002, lr_0 = 9.1825e-04
Validation auc = 0.688546
Epoch 1647
Validation auc = 0.688328
Epoch 1648
Validation auc = 0.688382
Epoch 1649
Validation auc = 0.688110
Epoch 1650
Loss = 7.3858e-06, PNorm = 120.6037, GNorm = 0.0001, lr_0 = 9.1804e-04
Loss = 1.1722e-06, PNorm = 120.6038, GNorm = 0.0001, lr_0 = 9.1803e-04
Validation auc = 0.687946
Epoch 1651
Validation auc = 0.687837
Epoch 1652
Validation auc = 0.687565
Epoch 1653
Validation auc = 0.687510
Epoch 1654
Validation auc = 0.687565
Epoch 1655
Loss = 5.4489e-06, PNorm = 120.6047, GNorm = 0.0002, lr_0 = 9.1780e-04
Loss = 3.7750e-07, PNorm = 120.6048, GNorm = 0.0000, lr_0 = 9.1778e-04
Validation auc = 0.687456
Epoch 1656
Validation auc = 0.687401
Epoch 1657
Validation auc = 0.687347
Epoch 1658
Validation auc = 0.687183
Epoch 1659
Validation auc = 0.686965
Epoch 1660
Loss = 9.3698e-07, PNorm = 120.6056, GNorm = 0.0000, lr_0 = 9.1757e-04
Validation auc = 0.686802
Epoch 1661
Validation auc = 0.686474
Epoch 1662
Validation auc = 0.686202
Epoch 1663
Validation auc = 0.685929
Epoch 1664
Validation auc = 0.686038
Epoch 1665
Loss = 5.2474e-06, PNorm = 120.6063, GNorm = 0.0003, lr_0 = 9.1733e-04
Validation auc = 0.686093
Epoch 1666
Validation auc = 0.686093
Epoch 1667
Validation auc = 0.686311
Epoch 1668
Validation auc = 0.686692
Epoch 1669
Loss = 3.1016e-05, PNorm = 120.6067, GNorm = 0.0001, lr_0 = 9.1712e-04
Loss = 5.7618e-07, PNorm = 120.6067, GNorm = 0.0000, lr_0 = 9.1710e-04
Validation auc = 0.686692
Epoch 1670
Validation auc = 0.687074
Epoch 1671
Validation auc = 0.687074
Epoch 1672
Validation auc = 0.687020
Epoch 1673
Validation auc = 0.687292
Epoch 1674
Loss = 6.2832e-06, PNorm = 120.6072, GNorm = 0.0005, lr_0 = 9.1687e-04
Validation auc = 0.686911
Epoch 1675
Validation auc = 0.686583
Epoch 1676
Validation auc = 0.686420
Epoch 1677
Validation auc = 0.687074
Epoch 1678
Validation auc = 0.687619
Epoch 1679
Loss = 1.2326e-06, PNorm = 120.6080, GNorm = 0.0001, lr_0 = 9.1664e-04
Validation auc = 0.687565
Epoch 1680
Validation auc = 0.687510
Epoch 1681
Validation auc = 0.687401
Epoch 1682
Validation auc = 0.687401
Epoch 1683
Loss = 4.6022e-06, PNorm = 120.6088, GNorm = 0.0001, lr_0 = 9.1642e-04
Validation auc = 0.687292
Epoch 1684
Validation auc = 0.687347
Epoch 1685
Validation auc = 0.687183
Epoch 1686
Validation auc = 0.687183
Epoch 1687
Validation auc = 0.686638
Epoch 1688
Loss = 4.8920e-06, PNorm = 120.6097, GNorm = 0.0007, lr_0 = 9.1619e-04
Loss = 5.1657e-06, PNorm = 120.6098, GNorm = 0.0002, lr_0 = 9.1617e-04
Validation auc = 0.686365
Epoch 1689
Validation auc = 0.686093
Epoch 1690
Validation auc = 0.686038
Epoch 1691
Validation auc = 0.685766
Epoch 1692
Validation auc = 0.685766
Epoch 1693
Loss = 1.0633e-06, PNorm = 120.6107, GNorm = 0.0000, lr_0 = 9.1596e-04
Validation auc = 0.685439
Epoch 1694
Validation auc = 0.684839
Epoch 1695
Validation auc = 0.684457
Epoch 1696
Validation auc = 0.683858
Epoch 1697
Validation auc = 0.684185
Epoch 1698
Loss = 3.3140e-07, PNorm = 120.6118, GNorm = 0.0000, lr_0 = 9.1572e-04
Validation auc = 0.684948
Epoch 1699
Validation auc = 0.685111
Epoch 1700
Validation auc = 0.685002
Epoch 1701
Validation auc = 0.685002
Epoch 1702
Loss = 2.8610e-06, PNorm = 120.6123, GNorm = 0.0001, lr_0 = 9.1551e-04
Loss = 9.9341e-08, PNorm = 120.6124, GNorm = 0.0000, lr_0 = 9.1549e-04
Validation auc = 0.684948
Epoch 1703
Validation auc = 0.684948
Epoch 1704
Validation auc = 0.684893
Epoch 1705
Validation auc = 0.684675
Epoch 1706
Validation auc = 0.684348
Epoch 1707
Loss = 3.2614e-06, PNorm = 120.6131, GNorm = 0.0001, lr_0 = 9.1526e-04
Loss = 9.9341e-08, PNorm = 120.6132, GNorm = 0.0000, lr_0 = 9.1525e-04
Validation auc = 0.684403
Epoch 1708
Validation auc = 0.684457
Epoch 1709
Validation auc = 0.684348
Epoch 1710
Validation auc = 0.684239
Epoch 1711
Validation auc = 0.684130
Epoch 1712
Loss = 3.0850e-06, PNorm = 120.6139, GNorm = 0.0001, lr_0 = 9.1504e-04
Validation auc = 0.683967
Epoch 1713
Validation auc = 0.683967
Epoch 1714
Validation auc = 0.683858
Epoch 1715
Validation auc = 0.684021
Epoch 1716
Loss = 1.4496e-06, PNorm = 120.6146, GNorm = 0.0000, lr_0 = 9.1481e-04
Validation auc = 0.683803
Epoch 1717
Validation auc = 0.683531
Epoch 1718
Validation auc = 0.683421
Epoch 1719
Validation auc = 0.683585
Epoch 1720
Validation auc = 0.683312
Epoch 1721
Loss = 2.3782e-06, PNorm = 120.6152, GNorm = 0.0001, lr_0 = 9.1458e-04
Loss = 3.9736e-08, PNorm = 120.6152, GNorm = 0.0000, lr_0 = 9.1457e-04
Validation auc = 0.683203
Epoch 1722
Validation auc = 0.683149
Epoch 1723
Validation auc = 0.683203
Epoch 1724
Validation auc = 0.683421
Epoch 1725
Validation auc = 0.683203
Epoch 1726
Loss = 4.5798e-06, PNorm = 120.6157, GNorm = 0.0003, lr_0 = 9.1436e-04
Validation auc = 0.683094
Epoch 1727
Validation auc = 0.683040
Epoch 1728
Validation auc = 0.682931
Epoch 1729
Validation auc = 0.682822
Epoch 1730
Validation auc = 0.682822
Epoch 1731
Loss = 2.2173e-06, PNorm = 120.6164, GNorm = 0.0001, lr_0 = 9.1411e-04
Validation auc = 0.682822
Epoch 1732
Validation auc = 0.682767
Epoch 1733
Validation auc = 0.682822
Epoch 1734
Validation auc = 0.682113
Epoch 1735
Loss = 1.0538e-06, PNorm = 120.6168, GNorm = 0.0000, lr_0 = 9.1390e-04
Loss = 6.7750e-06, PNorm = 120.6168, GNorm = 0.0006, lr_0 = 9.1389e-04
Validation auc = 0.682168
Epoch 1736
Validation auc = 0.681568
Epoch 1737
Validation auc = 0.681241
Epoch 1738
Validation auc = 0.681023
Epoch 1739
Validation auc = 0.681459
Epoch 1740
Loss = 1.8441e-06, PNorm = 120.6174, GNorm = 0.0001, lr_0 = 9.1366e-04
Loss = 1.3312e-06, PNorm = 120.6174, GNorm = 0.0001, lr_0 = 9.1364e-04
Validation auc = 0.681295
Epoch 1741
Validation auc = 0.681350
Epoch 1742
Validation auc = 0.681513
Epoch 1743
Validation auc = 0.681677
Epoch 1744
Validation auc = 0.681513
Epoch 1745
Loss = 2.2649e-06, PNorm = 120.6177, GNorm = 0.0001, lr_0 = 9.1343e-04
Validation auc = 0.681568
Epoch 1746
Validation auc = 0.681350
Epoch 1747
Validation auc = 0.681404
Epoch 1748
Validation auc = 0.681350
Epoch 1749
Loss = 1.1388e-06, PNorm = 120.6183, GNorm = 0.0000, lr_0 = 9.1320e-04
Validation auc = 0.681186
Epoch 1750
Validation auc = 0.681132
Epoch 1751
Validation auc = 0.681295
Epoch 1752
Validation auc = 0.680968
Epoch 1753
Validation auc = 0.680805
Epoch 1754
Loss = 3.7931e-06, PNorm = 120.6191, GNorm = 0.0002, lr_0 = 9.1298e-04
Loss = 1.7683e-06, PNorm = 120.6192, GNorm = 0.0002, lr_0 = 9.1296e-04
Validation auc = 0.680696
Epoch 1755
Validation auc = 0.680587
Epoch 1756
Validation auc = 0.680696
Epoch 1757
Validation auc = 0.680696
Epoch 1758
Validation auc = 0.680805
Epoch 1759
Loss = 4.8399e-07, PNorm = 120.6197, GNorm = 0.0000, lr_0 = 9.1275e-04
Validation auc = 0.680750
Epoch 1760
Validation auc = 0.680696
Epoch 1761
Validation auc = 0.680696
Epoch 1762
Validation auc = 0.680696
Epoch 1763
Validation auc = 0.680587
Epoch 1764
Loss = 6.3896e-07, PNorm = 120.6203, GNorm = 0.0000, lr_0 = 9.1251e-04
Validation auc = 0.680369
Epoch 1765
Validation auc = 0.680259
Epoch 1766
Validation auc = 0.680259
Epoch 1767
Validation auc = 0.680478
Epoch 1768
Loss = 7.0691e-07, PNorm = 120.6205, GNorm = 0.0000, lr_0 = 9.1230e-04
Loss = 1.7881e-07, PNorm = 120.6205, GNorm = 0.0000, lr_0 = 9.1228e-04
Validation auc = 0.680369
Epoch 1769
Validation auc = 0.680314
Epoch 1770
Validation auc = 0.680259
Epoch 1771
Validation auc = 0.679169
Epoch 1772
Validation auc = 0.678133
Epoch 1773
Loss = 3.1673e-06, PNorm = 120.6186, GNorm = 0.0001, lr_0 = 9.1206e-04
Loss = 3.5762e-06, PNorm = 120.6186, GNorm = 0.0004, lr_0 = 9.1204e-04
Validation auc = 0.676443
Epoch 1774
Validation auc = 0.675571
Epoch 1775
Validation auc = 0.675517
Epoch 1776
Validation auc = 0.675244
Epoch 1777
Validation auc = 0.675244
Epoch 1778
Loss = 2.2801e-05, PNorm = 120.6191, GNorm = 0.0018, lr_0 = 9.1183e-04
Validation auc = 0.675571
Epoch 1779
Validation auc = 0.675680
Epoch 1780
Validation auc = 0.675571
Epoch 1781
Validation auc = 0.675298
Epoch 1782
Validation auc = 0.674753
Epoch 1783
Loss = 6.2199e-06, PNorm = 120.6207, GNorm = 0.0006, lr_0 = 9.1159e-04
Validation auc = 0.675135
Epoch 1784
Validation auc = 0.675789
Epoch 1785
Validation auc = 0.675844
Epoch 1786
Validation auc = 0.675571
Epoch 1787
Loss = 2.8967e-06, PNorm = 120.6219, GNorm = 0.0001, lr_0 = 9.1138e-04
Loss = 4.2716e-06, PNorm = 120.6219, GNorm = 0.0003, lr_0 = 9.1136e-04
Validation auc = 0.675244
Epoch 1788
Validation auc = 0.675517
Epoch 1789
Validation auc = 0.675462
Epoch 1790
Validation auc = 0.675408
Epoch 1791
Validation auc = 0.675408
Epoch 1792
Loss = 3.7359e-06, PNorm = 120.6230, GNorm = 0.0002, lr_0 = 9.1115e-04
Validation auc = 0.675408
Epoch 1793
Validation auc = 0.675408
Epoch 1794
Validation auc = 0.675408
Epoch 1795
Validation auc = 0.675298
Epoch 1796
Validation auc = 0.675135
Epoch 1797
Loss = 6.9618e-07, PNorm = 120.6240, GNorm = 0.0000, lr_0 = 9.1091e-04
Validation auc = 0.674862
Epoch 1798
Validation auc = 0.674154
Epoch 1799
Validation auc = 0.674099
Epoch 1800
Validation auc = 0.673936
Epoch 1801
Loss = 1.1051e-06, PNorm = 120.6247, GNorm = 0.0001, lr_0 = 9.1070e-04
Loss = 3.3776e-07, PNorm = 120.6247, GNorm = 0.0000, lr_0 = 9.1068e-04
Validation auc = 0.673936
Epoch 1802
Validation auc = 0.673990
Epoch 1803
Validation auc = 0.674099
Epoch 1804
Validation auc = 0.674045
Epoch 1805
Validation auc = 0.674154
Epoch 1806
Loss = 9.8824e-07, PNorm = 120.6250, GNorm = 0.0000, lr_0 = 9.1046e-04
Loss = 3.3776e-06, PNorm = 120.6250, GNorm = 0.0002, lr_0 = 9.1044e-04
Validation auc = 0.674317
Epoch 1807
Validation auc = 0.674590
Epoch 1808
Validation auc = 0.674644
Epoch 1809
Validation auc = 0.674481
Epoch 1810
Validation auc = 0.674535
Epoch 1811
Loss = 1.1277e-06, PNorm = 120.6254, GNorm = 0.0001, lr_0 = 9.1023e-04
Validation auc = 0.674426
Epoch 1812
Validation auc = 0.674426
Epoch 1813
Validation auc = 0.674426
Epoch 1814
Validation auc = 0.674317
Epoch 1815
Validation auc = 0.674263
Epoch 1816
Loss = 1.2302e-06, PNorm = 120.6259, GNorm = 0.0000, lr_0 = 9.0999e-04
Validation auc = 0.674263
Epoch 1817
Validation auc = 0.674154
Epoch 1818
Validation auc = 0.674317
Epoch 1819
Validation auc = 0.674263
Epoch 1820
Loss = 1.1051e-06, PNorm = 120.6261, GNorm = 0.0000, lr_0 = 9.0978e-04
Loss = 3.3776e-07, PNorm = 120.6262, GNorm = 0.0000, lr_0 = 9.0976e-04
Validation auc = 0.674154
Epoch 1821
Validation auc = 0.674099
Epoch 1822
Validation auc = 0.674045
Epoch 1823
Validation auc = 0.673936
Epoch 1824
Validation auc = 0.673936
Epoch 1825
Loss = 1.6236e-06, PNorm = 120.6264, GNorm = 0.0001, lr_0 = 9.0955e-04
Validation auc = 0.673936
Epoch 1826
Validation auc = 0.673990
Epoch 1827
Validation auc = 0.673881
Epoch 1828
Validation auc = 0.673936
Epoch 1829
Validation auc = 0.673990
Epoch 1830
Loss = 5.6982e-07, PNorm = 120.6268, GNorm = 0.0000, lr_0 = 9.0931e-04
Validation auc = 0.673936
Epoch 1831
Validation auc = 0.673772
Epoch 1832
Validation auc = 0.673608
Epoch 1833
Validation auc = 0.673663
Epoch 1834
Loss = 2.4389e-06, PNorm = 120.6272, GNorm = 0.0000, lr_0 = 9.0910e-04
Loss = 9.9341e-08, PNorm = 120.6273, GNorm = 0.0000, lr_0 = 9.0909e-04
Validation auc = 0.673881
Epoch 1835
Validation auc = 0.673717
Epoch 1836
Validation auc = 0.673990
Epoch 1837
Validation auc = 0.673990
Epoch 1838
Validation auc = 0.673881
Epoch 1839
Loss = 1.8024e-06, PNorm = 120.6275, GNorm = 0.0001, lr_0 = 9.0886e-04
Loss = 1.7484e-06, PNorm = 120.6275, GNorm = 0.0002, lr_0 = 9.0884e-04
Validation auc = 0.673936
Epoch 1840
Validation auc = 0.673881
Epoch 1841
Validation auc = 0.673717
Epoch 1842
Validation auc = 0.673608
Epoch 1843
Validation auc = 0.673827
Epoch 1844
Loss = 1.7023e-06, PNorm = 120.6279, GNorm = 0.0001, lr_0 = 9.0863e-04
Validation auc = 0.673554
Epoch 1845
Validation auc = 0.673499
Epoch 1846
Validation auc = 0.673772
Epoch 1847
Validation auc = 0.673554
Epoch 1848
Validation auc = 0.673663
Epoch 1849
Loss = 8.7737e-07, PNorm = 120.6284, GNorm = 0.0000, lr_0 = 9.0839e-04
Validation auc = 0.673663
Epoch 1850
Validation auc = 0.673554
Epoch 1851
Validation auc = 0.673445
Epoch 1852
Validation auc = 0.673608
Epoch 1853
Loss = 1.0383e-06, PNorm = 120.6288, GNorm = 0.0000, lr_0 = 9.0818e-04
Loss = 6.3578e-07, PNorm = 120.6288, GNorm = 0.0000, lr_0 = 9.0817e-04
Validation auc = 0.673554
Epoch 1854
Validation auc = 0.673445
Epoch 1855
Validation auc = 0.673227
Epoch 1856
Validation auc = 0.673336
Epoch 1857
Validation auc = 0.673554
Epoch 1858
Loss = 9.7870e-07, PNorm = 120.6292, GNorm = 0.0000, lr_0 = 9.0794e-04
Validation auc = 0.673281
Epoch 1859
Validation auc = 0.673336
Epoch 1860
Validation auc = 0.673118
Epoch 1861
Validation auc = 0.673063
Epoch 1862
Validation auc = 0.672954
Epoch 1863
Loss = 8.2254e-07, PNorm = 120.6294, GNorm = 0.0000, lr_0 = 9.0772e-04
Validation auc = 0.673009
Epoch 1864
Validation auc = 0.672954
Epoch 1865
Validation auc = 0.672791
Epoch 1866
Validation auc = 0.672845
Epoch 1867
Loss = 8.7142e-07, PNorm = 120.6296, GNorm = 0.0001, lr_0 = 9.0751e-04
Loss = 1.0133e-06, PNorm = 120.6297, GNorm = 0.0001, lr_0 = 9.0749e-04
Validation auc = 0.673009
Epoch 1868
Validation auc = 0.673009
Epoch 1869
Validation auc = 0.673063
Epoch 1870
Validation auc = 0.673009
Epoch 1871
Validation auc = 0.672954
Epoch 1872
Loss = 2.2684e-06, PNorm = 120.6301, GNorm = 0.0000, lr_0 = 9.0727e-04
Loss = 3.5763e-07, PNorm = 120.6301, GNorm = 0.0000, lr_0 = 9.0725e-04
Validation auc = 0.673009
Epoch 1873
Validation auc = 0.672845
Epoch 1874
Validation auc = 0.672845
Epoch 1875
Validation auc = 0.672791
Epoch 1876
Validation auc = 0.672736
Epoch 1877
Loss = 1.0133e-06, PNorm = 120.6305, GNorm = 0.0000, lr_0 = 9.0704e-04
Validation auc = 0.672736
Epoch 1878
Validation auc = 0.672682
Epoch 1879
Validation auc = 0.672627
Epoch 1880
Validation auc = 0.672682
Epoch 1881
Validation auc = 0.672573
Epoch 1882
Loss = 5.6743e-07, PNorm = 120.6308, GNorm = 0.0000, lr_0 = 9.0680e-04
Validation auc = 0.672627
Epoch 1883
Validation auc = 0.672518
Epoch 1884
Validation auc = 0.673227
Epoch 1885
Validation auc = 0.673827
Epoch 1886
Loss = 7.0333e-07, PNorm = 120.6311, GNorm = 0.0000, lr_0 = 9.0659e-04
Loss = 7.9473e-08, PNorm = 120.6312, GNorm = 0.0000, lr_0 = 9.0657e-04
Validation auc = 0.673936
Epoch 1887
Validation auc = 0.673717
Epoch 1888
Validation auc = 0.673881
Epoch 1889
Validation auc = 0.674045
Epoch 1890
Validation auc = 0.674154
Epoch 1891
Loss = 5.9366e-07, PNorm = 120.6316, GNorm = 0.0000, lr_0 = 9.0635e-04
Validation auc = 0.674099
Epoch 1892
Validation auc = 0.674099
Epoch 1893
Validation auc = 0.674099
Epoch 1894
Validation auc = 0.674154
Epoch 1895
Validation auc = 0.674045
Epoch 1896
Loss = 4.0531e-07, PNorm = 120.6320, GNorm = 0.0000, lr_0 = 9.0612e-04
Validation auc = 0.673717
Epoch 1897
Validation auc = 0.673608
Epoch 1898
Validation auc = 0.673554
Epoch 1899
Validation auc = 0.673881
Epoch 1900
Loss = 7.8320e-07, PNorm = 120.6322, GNorm = 0.0000, lr_0 = 9.0592e-04
Loss = 5.8809e-06, PNorm = 120.6322, GNorm = 0.0003, lr_0 = 9.0590e-04
Validation auc = 0.674263
Epoch 1901
Validation auc = 0.674317
Epoch 1902
Validation auc = 0.674644
Epoch 1903
Validation auc = 0.674808
Epoch 1904
Validation auc = 0.674808
Epoch 1905
Loss = 8.3565e-07, PNorm = 120.6324, GNorm = 0.0000, lr_0 = 9.0567e-04
Loss = 1.9868e-08, PNorm = 120.6325, GNorm = 0.0000, lr_0 = 9.0566e-04
Validation auc = 0.674753
Epoch 1906
Validation auc = 0.674535
Epoch 1907
Validation auc = 0.674644
Epoch 1908
Validation auc = 0.674535
Epoch 1909
Validation auc = 0.674535
Epoch 1910
Loss = 7.7009e-07, PNorm = 120.6327, GNorm = 0.0000, lr_0 = 9.0545e-04
Validation auc = 0.674317
Epoch 1911
Validation auc = 0.674208
Epoch 1912
Validation auc = 0.674208
Epoch 1913
Validation auc = 0.674045
Epoch 1914
Validation auc = 0.673990
Epoch 1915
Loss = 3.3855e-07, PNorm = 120.6331, GNorm = 0.0000, lr_0 = 9.0521e-04
Validation auc = 0.674099
Epoch 1916
Validation auc = 0.673990
Epoch 1917
Validation auc = 0.674099
Epoch 1918
Validation auc = 0.674045
Epoch 1919
Loss = 5.7816e-07, PNorm = 120.6333, GNorm = 0.0000, lr_0 = 9.0500e-04
Loss = 7.5499e-07, PNorm = 120.6334, GNorm = 0.0000, lr_0 = 9.0498e-04
Validation auc = 0.673990
Epoch 1920
Validation auc = 0.674045
Epoch 1921
Validation auc = 0.674045
Epoch 1922
Validation auc = 0.673990
Epoch 1923
Validation auc = 0.674045
Epoch 1924
Loss = 1.4174e-06, PNorm = 120.6336, GNorm = 0.0000, lr_0 = 9.0476e-04
Validation auc = 0.674208
Epoch 1925
Validation auc = 0.674426
Epoch 1926
Validation auc = 0.674481
Epoch 1927
Validation auc = 0.674481
Epoch 1928
Validation auc = 0.674481
Epoch 1929
Loss = 9.2506e-07, PNorm = 120.6338, GNorm = 0.0001, lr_0 = 9.0454e-04
Validation auc = 0.674481
Epoch 1930
Validation auc = 0.674481
Epoch 1931
Validation auc = 0.674590
Epoch 1932
Validation auc = 0.674535
Epoch 1933
Loss = 6.3790e-07, PNorm = 120.6339, GNorm = 0.0000, lr_0 = 9.0431e-04
Validation auc = 0.674699
Epoch 1934
Validation auc = 0.674753
Epoch 1935
Validation auc = 0.674699
Epoch 1936
Validation auc = 0.674590
Epoch 1937
Validation auc = 0.674535
Epoch 1938
Loss = 1.5270e-06, PNorm = 120.6341, GNorm = 0.0000, lr_0 = 9.0409e-04
Loss = 1.9868e-08, PNorm = 120.6341, GNorm = 0.0000, lr_0 = 9.0407e-04
Validation auc = 0.674644
Epoch 1939
Validation auc = 0.674699
Epoch 1940
Validation auc = 0.674644
Epoch 1941
Validation auc = 0.675026
Epoch 1942
Validation auc = 0.675135
Epoch 1943
Loss = 1.6928e-07, PNorm = 120.6340, GNorm = 0.0000, lr_0 = 9.0386e-04
Validation auc = 0.675353
Epoch 1944
Validation auc = 0.675135
Epoch 1945
Validation auc = 0.675244
Epoch 1946
Validation auc = 0.675189
Epoch 1947
Validation auc = 0.675244
Epoch 1948
Loss = 1.1921e-06, PNorm = 120.6340, GNorm = 0.0000, lr_0 = 9.0362e-04
Validation auc = 0.675298
Epoch 1949
Validation auc = 0.675244
Epoch 1950
Validation auc = 0.675189
Epoch 1951
Validation auc = 0.675353
Epoch 1952
Loss = 5.6028e-07, PNorm = 120.6342, GNorm = 0.0000, lr_0 = 9.0341e-04
Loss = 1.9868e-07, PNorm = 120.6343, GNorm = 0.0000, lr_0 = 9.0340e-04
Validation auc = 0.675244
Epoch 1953
Validation auc = 0.675080
Epoch 1954
Validation auc = 0.675135
Epoch 1955
Validation auc = 0.675189
Epoch 1956
Validation auc = 0.675080
Epoch 1957
Loss = 7.6770e-07, PNorm = 120.6338, GNorm = 0.0000, lr_0 = 9.0317e-04
Loss = 1.5895e-07, PNorm = 120.6337, GNorm = 0.0000, lr_0 = 9.0316e-04
Validation auc = 0.675135
Epoch 1958
Validation auc = 0.675626
Epoch 1959
Validation auc = 0.675571
Epoch 1960
Validation auc = 0.675844
Epoch 1961
Validation auc = 0.675953
Epoch 1962
Loss = 2.9540e-06, PNorm = 120.6335, GNorm = 0.0001, lr_0 = 9.0295e-04
Validation auc = 0.676443
Epoch 1963
Validation auc = 0.677152
Epoch 1964
Validation auc = 0.677643
Epoch 1965
Validation auc = 0.677643
Epoch 1966
Loss = 6.9167e-07, PNorm = 120.6343, GNorm = 0.0000, lr_0 = 9.0273e-04
Validation auc = 0.677534
Epoch 1967
Validation auc = 0.677697
Epoch 1968
Validation auc = 0.677152
Epoch 1969
Validation auc = 0.677316
Epoch 1970
Validation auc = 0.677697
Epoch 1971
Loss = 3.3781e-06, PNorm = 120.6349, GNorm = 0.0005, lr_0 = 9.0250e-04
Loss = 5.5631e-07, PNorm = 120.6350, GNorm = 0.0000, lr_0 = 9.0249e-04
Validation auc = 0.677915
Epoch 1972
Validation auc = 0.678242
Epoch 1973
Validation auc = 0.678079
Epoch 1974
Validation auc = 0.677915
Epoch 1975
Validation auc = 0.677970
Epoch 1976
Loss = 5.0802e-06, PNorm = 120.6352, GNorm = 0.0006, lr_0 = 9.0228e-04
Validation auc = 0.677915
Epoch 1977
Validation auc = 0.678515
Epoch 1978
Validation auc = 0.678133
Epoch 1979
Validation auc = 0.678460
Epoch 1980
Validation auc = 0.678679
Epoch 1981
Loss = 2.0480e-06, PNorm = 120.6355, GNorm = 0.0001, lr_0 = 9.0204e-04
Validation auc = 0.678624
Epoch 1982
Validation auc = 0.678842
Epoch 1983
Validation auc = 0.678679
Epoch 1984
Validation auc = 0.678679
Epoch 1985
Loss = 5.1737e-07, PNorm = 120.6359, GNorm = 0.0000, lr_0 = 9.0183e-04
Loss = 1.7285e-06, PNorm = 120.6359, GNorm = 0.0001, lr_0 = 9.0181e-04
Validation auc = 0.678351
Epoch 1986
Validation auc = 0.678679
Epoch 1987
Validation auc = 0.678897
Epoch 1988
Validation auc = 0.678897
Epoch 1989
Validation auc = 0.678897
Epoch 1990
Loss = 2.1170e-06, PNorm = 120.6360, GNorm = 0.0003, lr_0 = 9.0159e-04
Loss = 2.5630e-06, PNorm = 120.6360, GNorm = 0.0002, lr_0 = 9.0157e-04
Validation auc = 0.678897
Epoch 1991
Validation auc = 0.678897
Epoch 1992
Validation auc = 0.678788
Epoch 1993
Validation auc = 0.678733
Epoch 1994
Validation auc = 0.678460
Epoch 1995
Loss = 1.3089e-06, PNorm = 120.6363, GNorm = 0.0000, lr_0 = 9.0137e-04
Validation auc = 0.678515
Epoch 1996
Validation auc = 0.678515
Epoch 1997
Validation auc = 0.678460
Epoch 1998
Validation auc = 0.678242
Epoch 1999
Loss = 1.1916e-06, PNorm = 120.6369, GNorm = 0.0002, lr_0 = 9.0114e-04
Validation auc = 0.678079
Model 0 best validation auc = 0.731778 on epoch 1191
Loading pretrained parameter "encoder.encoder.0.cached_zero_vector".
Loading pretrained parameter "encoder.encoder.0.W_i.weight".
Loading pretrained parameter "encoder.encoder.0.W_h.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.bias".
Loading pretrained parameter "ffn.1.weight".
Loading pretrained parameter "ffn.1.bias".
Moving model to cuda
Model 0 test auc = 0.690490
Ensemble test auc = 0.690490
Fold 5
Splitting data with seed 5
Class sizes
sars_cov_two_active 0: 98.39%, 1: 1.61%
Total size = 3,294 | train size = 3,294 | val size = 1,096 | test size = 1,086
With class_balance, effective train size = 106
Building model 0
MoleculeModel(
  (sigmoid): Sigmoid()
  (encoder): MPN(
    (encoder): ModuleList(
      (0): MPNEncoder(
        (dropout_layer): Dropout(p=0.05, inplace=False)
        (act_func): ReLU()
        (W_i): Linear(in_features=147, out_features=2100, bias=False)
        (W_h): Linear(in_features=2100, out_features=2100, bias=False)
        (W_o): Linear(in_features=2233, out_features=2100, bias=True)
      )
    )
  )
  (ffn): Sequential(
    (0): Dropout(p=0.05, inplace=False)
    (1): Linear(in_features=2328, out_features=1, bias=True)
  )
)
Number of parameters = 9,412,429
Moving model to cuda
Epoch 0
Validation auc = 0.630050
Epoch 1
Validation auc = 0.519599
Epoch 2
Validation auc = 0.568609
Epoch 3
Validation auc = 0.605572
Epoch 4
Loss = 7.3404e-01, PNorm = 67.4095, GNorm = 1.2691, lr_0 = 2.0385e-04
Loss = 6.8951e-01, PNorm = 67.4115, GNorm = 2.7562, lr_0 = 2.1077e-04
Validation auc = 0.590689
Epoch 5
Validation auc = 0.586600
Epoch 6
Validation auc = 0.591506
Epoch 7
Validation auc = 0.580985
Epoch 8
Validation auc = 0.598266
Epoch 9
Loss = 6.9231e-01, PNorm = 67.4479, GNorm = 0.9570, lr_0 = 3.0077e-04
Validation auc = 0.647659
Epoch 10
Validation auc = 0.656872
Epoch 11
Validation auc = 0.673990
Epoch 12
Validation auc = 0.681731
Epoch 13
Validation auc = 0.696233
Epoch 14
Loss = 6.5674e-01, PNorm = 67.5104, GNorm = 1.4151, lr_0 = 4.0462e-04
Validation auc = 0.684294
Epoch 15
Validation auc = 0.685275
Epoch 16
Validation auc = 0.657744
Epoch 17
Validation auc = 0.682113
Epoch 18
Loss = 5.8229e-01, PNorm = 67.5962, GNorm = 0.9028, lr_0 = 4.9462e-04
Loss = 7.0348e-01, PNorm = 67.6054, GNorm = 2.6904, lr_0 = 5.0154e-04
Validation auc = 0.696124
Epoch 19
Validation auc = 0.675953
Epoch 20
Validation auc = 0.627487
Epoch 21
Validation auc = 0.593687
Epoch 22
Validation auc = 0.556834
Epoch 23
Loss = 6.5933e-01, PNorm = 67.7415, GNorm = 0.8668, lr_0 = 5.9846e-04
Loss = 6.4299e-01, PNorm = 67.7528, GNorm = 2.1561, lr_0 = 6.0538e-04
Validation auc = 0.553236
Epoch 24
Validation auc = 0.492558
Epoch 25
Validation auc = 0.592433
Epoch 26
Validation auc = 0.600829
Epoch 27
Validation auc = 0.615167
Epoch 28
Loss = 6.4111e-01, PNorm = 67.9257, GNorm = 0.9887, lr_0 = 6.9538e-04
Validation auc = 0.625307
Epoch 29
Validation auc = 0.618001
Epoch 30
Validation auc = 0.671428
Epoch 31
Validation auc = 0.660961
Epoch 32
Validation auc = 0.653710
Epoch 33
Loss = 6.2340e-01, PNorm = 68.1659, GNorm = 1.1154, lr_0 = 7.9923e-04
Validation auc = 0.659271
Epoch 34
Validation auc = 0.663468
Epoch 35
Validation auc = 0.659979
Epoch 36
Validation auc = 0.655672
Epoch 37
Loss = 6.1176e-01, PNorm = 68.4212, GNorm = 0.8137, lr_0 = 8.8923e-04
Loss = 5.9380e-01, PNorm = 68.4356, GNorm = 3.5189, lr_0 = 8.9615e-04
Validation auc = 0.659816
Epoch 38
Validation auc = 0.676389
Epoch 39
Validation auc = 0.671646
Epoch 40
Validation auc = 0.617511
Epoch 41
Validation auc = 0.604209
Epoch 42
Loss = 6.2746e-01, PNorm = 68.7717, GNorm = 0.7882, lr_0 = 9.8615e-04
Validation auc = 0.614240
Epoch 43
Validation auc = 0.626015
Epoch 44
Validation auc = 0.626779
Epoch 45
Validation auc = 0.657635
Epoch 46
Validation auc = 0.655291
Epoch 47
Loss = 5.6261e-01, PNorm = 69.3691, GNorm = 1.0705, lr_0 = 9.9977e-04
Validation auc = 0.635229
Epoch 48
Validation auc = 0.637791
Epoch 49
Validation auc = 0.618928
Epoch 50
Validation auc = 0.601701
Epoch 51
Loss = 5.8426e-01, PNorm = 69.8504, GNorm = 1.7630, lr_0 = 9.9954e-04
Loss = 6.6211e-01, PNorm = 69.8807, GNorm = 4.0406, lr_0 = 9.9952e-04
Validation auc = 0.601319
Epoch 52
Validation auc = 0.596576
Epoch 53
Validation auc = 0.612332
Epoch 54
Validation auc = 0.616311
Epoch 55
Validation auc = 0.613858
Epoch 56
Loss = 5.4532e-01, PNorm = 70.3718, GNorm = 1.0500, lr_0 = 9.9927e-04
Loss = 4.5957e-01, PNorm = 70.4106, GNorm = 2.8104, lr_0 = 9.9926e-04
Validation auc = 0.609987
Epoch 57
Validation auc = 0.580548
Epoch 58
Validation auc = 0.564793
Epoch 59
Validation auc = 0.574279
Epoch 60
Validation auc = 0.570245
Epoch 61
Loss = 4.2643e-01, PNorm = 70.9275, GNorm = 1.0684, lr_0 = 9.9903e-04
Validation auc = 0.589653
Epoch 62
Validation auc = 0.579404
Epoch 63
Validation auc = 0.602846
Epoch 64
Validation auc = 0.621272
Epoch 65
Validation auc = 0.615548
Epoch 66
Loss = 5.5205e-01, PNorm = 71.6948, GNorm = 0.6512, lr_0 = 9.9876e-04
Validation auc = 0.606989
Epoch 67
Validation auc = 0.597285
Epoch 68
Validation auc = 0.595486
Epoch 69
Validation auc = 0.598430
Epoch 70
Loss = 5.4324e-01, PNorm = 72.1723, GNorm = 0.7986, lr_0 = 9.9853e-04
Loss = 6.7909e-01, PNorm = 72.2048, GNorm = 2.4563, lr_0 = 9.9851e-04
Validation auc = 0.604536
Epoch 71
Validation auc = 0.616802
Epoch 72
Validation auc = 0.626397
Epoch 73
Validation auc = 0.648640
Epoch 74
Validation auc = 0.670774
Epoch 75
Loss = 3.8420e-01, PNorm = 72.5779, GNorm = 0.9545, lr_0 = 9.9828e-04
Validation auc = 0.674862
Epoch 76
Validation auc = 0.697705
Epoch 77
Validation auc = 0.682113
Epoch 78
Validation auc = 0.663686
Epoch 79
Validation auc = 0.641444
Epoch 80
Loss = 4.8830e-01, PNorm = 73.0871, GNorm = 0.9902, lr_0 = 9.9802e-04
Validation auc = 0.624216
Epoch 81
Validation auc = 0.610369
Epoch 82
Validation auc = 0.608516
Epoch 83
Validation auc = 0.622199
Epoch 84
Loss = 3.9233e-01, PNorm = 73.6606, GNorm = 1.1317, lr_0 = 9.9779e-04
Loss = 3.0981e-01, PNorm = 73.7116, GNorm = 1.6543, lr_0 = 9.9777e-04
Validation auc = 0.645532
Epoch 85
Validation auc = 0.680096
Epoch 86
Validation auc = 0.675844
Epoch 87
Validation auc = 0.678297
Epoch 88
Validation auc = 0.640081
Epoch 89
Loss = 4.3232e-01, PNorm = 74.4320, GNorm = 1.4252, lr_0 = 9.9752e-04
Loss = 2.7490e-01, PNorm = 74.4912, GNorm = 2.4612, lr_0 = 9.9750e-04
Validation auc = 0.600992
Epoch 90
Validation auc = 0.601974
Epoch 91
Validation auc = 0.620618
Epoch 92
Validation auc = 0.626942
Epoch 93
Validation auc = 0.606607
Epoch 94
Loss = 1.4940e-01, PNorm = 75.1963, GNorm = 0.5511, lr_0 = 9.9727e-04
Validation auc = 0.610151
Epoch 95
Validation auc = 0.615766
Epoch 96
Validation auc = 0.619964
Epoch 97
Validation auc = 0.614948
Epoch 98
Validation auc = 0.630867
Epoch 99
Loss = 2.2060e-01, PNorm = 75.9114, GNorm = 1.2906, lr_0 = 9.9701e-04
Validation auc = 0.608788
Epoch 100
Validation auc = 0.636265
Epoch 101
Validation auc = 0.631249
Epoch 102
Validation auc = 0.635719
Epoch 103
Loss = 1.9711e-01, PNorm = 76.5664, GNorm = 3.6753, lr_0 = 9.9678e-04
Loss = 1.5603e-01, PNorm = 76.6133, GNorm = 1.1297, lr_0 = 9.9676e-04
Validation auc = 0.629123
Epoch 104
Validation auc = 0.612114
Epoch 105
Validation auc = 0.607316
Epoch 106
Validation auc = 0.593632
Epoch 107
Validation auc = 0.636919
Epoch 108
Loss = 2.7709e-01, PNorm = 77.1804, GNorm = 1.1588, lr_0 = 9.9651e-04
Validation auc = 0.644333
Epoch 109
Validation auc = 0.673281
Epoch 110
Validation auc = 0.667339
Epoch 111
Validation auc = 0.656708
Epoch 112
Validation auc = 0.625797
Epoch 113
Loss = 3.2117e-01, PNorm = 77.9026, GNorm = 1.7061, lr_0 = 9.9627e-04
Validation auc = 0.621054
Epoch 114
Validation auc = 0.624761
Epoch 115
Validation auc = 0.636864
Epoch 116
Validation auc = 0.671373
Epoch 117
Loss = 1.9209e-01, PNorm = 78.5165, GNorm = 0.8029, lr_0 = 9.9604e-04
Loss = 5.3519e-02, PNorm = 78.5612, GNorm = 0.9363, lr_0 = 9.9602e-04
Validation auc = 0.661070
Epoch 118
Validation auc = 0.660088
Epoch 119
Validation auc = 0.659216
Epoch 120
Validation auc = 0.650166
Epoch 121
Validation auc = 0.652838
Epoch 122
Loss = 2.0109e-01, PNorm = 79.1150, GNorm = 1.8698, lr_0 = 9.9577e-04
Loss = 2.8978e-01, PNorm = 79.1482, GNorm = 4.3685, lr_0 = 9.9575e-04
Validation auc = 0.667939
Epoch 123
Validation auc = 0.692417
Epoch 124
Validation auc = 0.701848
Epoch 125
Validation auc = 0.697160
Epoch 126
Validation auc = 0.672573
Epoch 127
Loss = 8.1335e-02, PNorm = 79.6422, GNorm = 0.8467, lr_0 = 9.9552e-04
Validation auc = 0.665431
Epoch 128
Validation auc = 0.661124
Epoch 129
Validation auc = 0.650057
Epoch 130
Validation auc = 0.641007
Epoch 131
Validation auc = 0.613749
Epoch 132
Loss = 3.6239e-01, PNorm = 80.2401, GNorm = 2.5493, lr_0 = 9.9526e-04
Validation auc = 0.596413
Epoch 133
Validation auc = 0.588617
Epoch 134
Validation auc = 0.584855
Epoch 135
Validation auc = 0.582020
Epoch 136
Loss = 3.1392e-01, PNorm = 81.1004, GNorm = 1.3813, lr_0 = 9.9503e-04
Loss = 2.7475e-01, PNorm = 81.1517, GNorm = 2.3415, lr_0 = 9.9501e-04
Validation auc = 0.584474
Epoch 137
Validation auc = 0.580548
Epoch 138
Validation auc = 0.565774
Epoch 139
Validation auc = 0.562831
Epoch 140
Validation auc = 0.567519
Epoch 141
Loss = 1.4005e-01, PNorm = 81.7379, GNorm = 1.4881, lr_0 = 9.9477e-04
Validation auc = 0.574824
Epoch 142
Validation auc = 0.593905
Epoch 143
Validation auc = 0.622363
Epoch 144
Validation auc = 0.614676
Epoch 145
Validation auc = 0.623017
Epoch 146
Loss = 6.3293e-02, PNorm = 82.1590, GNorm = 0.6050, lr_0 = 9.9452e-04
Validation auc = 0.619528
Epoch 147
Validation auc = 0.605572
Epoch 148
Validation auc = 0.585564
Epoch 149
Validation auc = 0.575424
Epoch 150
Loss = 8.1805e-02, PNorm = 82.4420, GNorm = 0.9694, lr_0 = 9.9429e-04
Loss = 1.3610e-03, PNorm = 82.4608, GNorm = 0.0520, lr_0 = 9.9427e-04
Validation auc = 0.546421
Epoch 151
Validation auc = 0.580385
Epoch 152
Validation auc = 0.600556
Epoch 153
Validation auc = 0.612386
Epoch 154
Validation auc = 0.625525
Epoch 155
Loss = 3.3273e-02, PNorm = 82.6975, GNorm = 0.5447, lr_0 = 9.9403e-04
Loss = 2.1624e-01, PNorm = 82.7166, GNorm = 3.2613, lr_0 = 9.9401e-04
Validation auc = 0.636864
Epoch 156
Validation auc = 0.646786
Epoch 157
Validation auc = 0.649239
Epoch 158
Validation auc = 0.643079
Epoch 159
Validation auc = 0.646841
Epoch 160
Loss = 1.5775e-01, PNorm = 82.9677, GNorm = 1.1995, lr_0 = 9.9378e-04
Validation auc = 0.669084
Epoch 161
Validation auc = 0.666085
Epoch 162
Validation auc = 0.623071
Epoch 163
Validation auc = 0.661506
Epoch 164
Validation auc = 0.673445
Epoch 165
Loss = 1.8736e-01, PNorm = 83.4642, GNorm = 2.1091, lr_0 = 9.9351e-04
Validation auc = 0.684076
Epoch 166
Validation auc = 0.690890
Epoch 167
Validation auc = 0.688382
Epoch 168
Validation auc = 0.684784
Epoch 169
Loss = 1.5953e-01, PNorm = 83.9497, GNorm = 0.8685, lr_0 = 9.9329e-04
Loss = 2.0483e-02, PNorm = 83.9812, GNorm = 0.5163, lr_0 = 9.9327e-04
Validation auc = 0.674481
Epoch 170
Validation auc = 0.669629
Epoch 171
Validation auc = 0.674317
Epoch 172
Validation auc = 0.684839
Epoch 173
Validation auc = 0.701139
Epoch 174
Loss = 8.3110e-02, PNorm = 84.3411, GNorm = 0.7053, lr_0 = 9.9302e-04
Validation auc = 0.691381
Epoch 175
Validation auc = 0.682549
Epoch 176
Validation auc = 0.678842
Epoch 177
Validation auc = 0.671264
Epoch 178
Validation auc = 0.659489
Epoch 179
Loss = 2.6139e-02, PNorm = 84.6259, GNorm = 0.3706, lr_0 = 9.9277e-04
Validation auc = 0.642643
Epoch 180
Validation auc = 0.645587
Epoch 181
Validation auc = 0.657853
Epoch 182
Validation auc = 0.658344
Epoch 183
Loss = 1.6831e-02, PNorm = 84.8691, GNorm = 0.0974, lr_0 = 9.9253e-04
Validation auc = 0.662869
Epoch 184
Validation auc = 0.667666
Epoch 185
Validation auc = 0.667448
Epoch 186
Validation auc = 0.664940
Epoch 187
Validation auc = 0.665649
Epoch 188
Loss = 2.5782e-02, PNorm = 85.0601, GNorm = 0.3679, lr_0 = 9.9228e-04
Loss = 6.5719e-03, PNorm = 85.0707, GNorm = 0.1764, lr_0 = 9.9226e-04
Validation auc = 0.669792
Epoch 189
Validation auc = 0.671319
Epoch 190
Validation auc = 0.667448
Epoch 191
Validation auc = 0.673172
Epoch 192
Validation auc = 0.688982
Epoch 193
Loss = 9.1910e-02, PNorm = 85.2955, GNorm = 1.2195, lr_0 = 9.9204e-04
Validation auc = 0.704628
Epoch 194
Validation auc = 0.709917
Epoch 195
Validation auc = 0.717167
Epoch 196
Validation auc = 0.691653
Epoch 197
Validation auc = 0.659761
Epoch 198
Loss = 1.4018e-01, PNorm = 85.9486, GNorm = 1.0358, lr_0 = 9.9177e-04
Validation auc = 0.628142
Epoch 199
Validation auc = 0.614131
Epoch 200
Validation auc = 0.615494
Epoch 201
Validation auc = 0.620073
Epoch 202
Loss = 1.4547e-01, PNorm = 86.4722, GNorm = 0.6437, lr_0 = 9.9154e-04
Loss = 2.9650e-02, PNorm = 86.5011, GNorm = 0.3977, lr_0 = 9.9153e-04
Validation auc = 0.619855
Epoch 203
Validation auc = 0.629068
Epoch 204
Validation auc = 0.642425
Epoch 205
Validation auc = 0.656872
Epoch 206
Validation auc = 0.663904
Epoch 207
Loss = 1.4089e-01, PNorm = 86.7736, GNorm = 0.6484, lr_0 = 9.9128e-04
Loss = 9.4001e-02, PNorm = 86.7896, GNorm = 2.2283, lr_0 = 9.9126e-04
Validation auc = 0.668266
Epoch 208
Validation auc = 0.673172
Epoch 209
Validation auc = 0.677261
Epoch 210
Validation auc = 0.679442
Epoch 211
Validation auc = 0.677261
Epoch 212
Loss = 1.2809e-01, PNorm = 86.9779, GNorm = 1.0371, lr_0 = 9.9103e-04
Validation auc = 0.641444
Epoch 213
Validation auc = 0.634629
Epoch 214
Validation auc = 0.715477
Epoch 215
Validation auc = 0.735812
Epoch 216
Loss = 7.2949e-02, PNorm = 87.3044, GNorm = 1.5557, lr_0 = 9.9079e-04
Validation auc = 0.738865
Epoch 217
Validation auc = 0.747642
Epoch 218
Validation auc = 0.741373
Epoch 219
Validation auc = 0.732323
Epoch 220
Validation auc = 0.722892
Epoch 221
Loss = 7.0004e-02, PNorm = 87.6110, GNorm = 0.4873, lr_0 = 9.9054e-04
Loss = 6.3900e-02, PNorm = 87.6273, GNorm = 1.2663, lr_0 = 9.9052e-04
Validation auc = 0.714441
Epoch 222
Validation auc = 0.705664
Epoch 223
Validation auc = 0.703538
Epoch 224
Validation auc = 0.707627
Epoch 225
Validation auc = 0.707082
Epoch 226
Loss = 1.7981e-02, PNorm = 87.7815, GNorm = 0.3173, lr_0 = 9.9030e-04
Validation auc = 0.706809
Epoch 227
Validation auc = 0.707027
Epoch 228
Validation auc = 0.706646
Epoch 229
Validation auc = 0.704247
Epoch 230
Validation auc = 0.703756
Epoch 231
Loss = 3.2970e-02, PNorm = 87.8756, GNorm = 0.6337, lr_0 = 9.9003e-04
Validation auc = 0.705392
Epoch 232
Validation auc = 0.706373
Epoch 233
Validation auc = 0.709099
Epoch 234
Validation auc = 0.705937
Epoch 235
Loss = 3.0150e-01, PNorm = 87.9712, GNorm = 9.5833, lr_0 = 9.8980e-04
Loss = 7.7159e-02, PNorm = 87.9929, GNorm = 2.2526, lr_0 = 9.8979e-04
Validation auc = 0.702284
Epoch 236
Validation auc = 0.707463
Epoch 237
Validation auc = 0.702066
Epoch 238
Validation auc = 0.696287
Epoch 239
Validation auc = 0.693780
Epoch 240
Loss = 1.6096e-01, PNorm = 88.3463, GNorm = 4.1958, lr_0 = 9.8954e-04
Loss = 8.4248e-02, PNorm = 88.3681, GNorm = 1.9012, lr_0 = 9.8952e-04
Validation auc = 0.696778
Epoch 241
Validation auc = 0.681404
Epoch 242
Validation auc = 0.683585
Epoch 243
Validation auc = 0.680587
Epoch 244
Validation auc = 0.684130
Epoch 245
Loss = 6.7285e-02, PNorm = 88.6808, GNorm = 0.6241, lr_0 = 9.8930e-04
Validation auc = 0.694052
Epoch 246
Validation auc = 0.696778
Epoch 247
Validation auc = 0.697650
Epoch 248
Validation auc = 0.705228
Epoch 249
Loss = 4.5639e-02, PNorm = 88.9207, GNorm = 0.1117, lr_0 = 9.8905e-04
Validation auc = 0.701466
Epoch 250
Validation auc = 0.699722
Epoch 251
Validation auc = 0.699177
Epoch 252
Validation auc = 0.695306
Epoch 253
Validation auc = 0.691653
Epoch 254
Loss = 9.4516e-02, PNorm = 89.0600, GNorm = 0.5388, lr_0 = 9.8880e-04
Loss = 2.0885e-02, PNorm = 89.0687, GNorm = 0.5613, lr_0 = 9.8879e-04
Validation auc = 0.693889
Epoch 255
Validation auc = 0.701357
Epoch 256
Validation auc = 0.707627
Epoch 257
Validation auc = 0.710353
Epoch 258
Validation auc = 0.713079
Epoch 259
Loss = 9.1191e-03, PNorm = 89.2001, GNorm = 0.1128, lr_0 = 9.8856e-04
Validation auc = 0.718421
Epoch 260
Validation auc = 0.722783
Epoch 261
Validation auc = 0.728888
Epoch 262
Validation auc = 0.729325
Epoch 263
Validation auc = 0.724963
Epoch 264
Loss = 2.6617e-02, PNorm = 89.2951, GNorm = 0.8212, lr_0 = 9.8830e-04
Validation auc = 0.726544
Epoch 265
Validation auc = 0.716404
Epoch 266
Validation auc = 0.704847
Epoch 267
Validation auc = 0.696560
Epoch 268
Loss = 3.5830e-02, PNorm = 89.3901, GNorm = 0.8229, lr_0 = 9.8807e-04
Loss = 1.2240e-02, PNorm = 89.3964, GNorm = 0.6686, lr_0 = 9.8805e-04
Validation auc = 0.692035
Epoch 269
Validation auc = 0.692853
Epoch 270
Validation auc = 0.688928
Epoch 271
Validation auc = 0.680968
Epoch 272
Validation auc = 0.677643
Epoch 273
Loss = 5.8888e-02, PNorm = 89.4915, GNorm = 1.4749, lr_0 = 9.8781e-04
Loss = 6.1278e-03, PNorm = 89.4985, GNorm = 0.1922, lr_0 = 9.8779e-04
Validation auc = 0.676934
Epoch 274
Validation auc = 0.676116
Epoch 275
Validation auc = 0.676988
Epoch 276
Validation auc = 0.676770
Epoch 277
Validation auc = 0.673118
Epoch 278
Loss = 7.9929e-02, PNorm = 89.5764, GNorm = 0.9571, lr_0 = 9.8756e-04
Validation auc = 0.660524
Epoch 279
Validation auc = 0.672573
Epoch 280
Validation auc = 0.681241
Epoch 281
Validation auc = 0.700049
Epoch 282
Validation auc = 0.693780
Epoch 283
Loss = 1.0643e-02, PNorm = 89.6813, GNorm = 0.5796, lr_0 = 9.8730e-04
Validation auc = 0.687946
Epoch 284
Validation auc = 0.682277
Epoch 285
Validation auc = 0.682277
Epoch 286
Validation auc = 0.681295
Epoch 287
Loss = 4.6971e-03, PNorm = 89.7676, GNorm = 0.0702, lr_0 = 9.8707e-04
Loss = 1.7844e-03, PNorm = 89.7722, GNorm = 0.0412, lr_0 = 9.8705e-04
Validation auc = 0.679442
Epoch 288
Validation auc = 0.677643
Epoch 289
Validation auc = 0.675026
Epoch 290
Validation auc = 0.673990
Epoch 291
Validation auc = 0.673827
Epoch 292
Loss = 6.5644e-03, PNorm = 89.8114, GNorm = 0.1307, lr_0 = 9.8683e-04
Validation auc = 0.671646
Epoch 293
Validation auc = 0.671210
Epoch 294
Validation auc = 0.683312
Epoch 295
Validation auc = 0.714878
Epoch 296
Validation auc = 0.729488
Epoch 297
Loss = 9.4267e-02, PNorm = 90.0167, GNorm = 1.3670, lr_0 = 9.8656e-04
Validation auc = 0.721093
Epoch 298
Validation auc = 0.717385
Epoch 299
Validation auc = 0.713624
Epoch 300
Validation auc = 0.706264
Epoch 301
Loss = 1.0227e-01, PNorm = 90.4370, GNorm = 0.8426, lr_0 = 9.8634e-04
Loss = 3.5828e-02, PNorm = 90.4654, GNorm = 0.9136, lr_0 = 9.8632e-04
Validation auc = 0.699231
Epoch 302
Validation auc = 0.690563
Epoch 303
Validation auc = 0.689582
Epoch 304
Validation auc = 0.682713
Epoch 305
Validation auc = 0.676552
Epoch 306
Loss = 2.0425e-02, PNorm = 90.7524, GNorm = 0.7270, lr_0 = 9.8607e-04
Loss = 6.9445e-03, PNorm = 90.7665, GNorm = 0.3028, lr_0 = 9.8606e-04
Validation auc = 0.673936
Epoch 307
Validation auc = 0.672736
Epoch 308
Validation auc = 0.671918
Epoch 309
Validation auc = 0.669084
Epoch 310
Validation auc = 0.664068
Epoch 311
Loss = 7.8570e-02, PNorm = 90.9086, GNorm = 0.8457, lr_0 = 9.8583e-04
Validation auc = 0.659325
Epoch 312
Validation auc = 0.654310
Epoch 313
Validation auc = 0.653328
Epoch 314
Validation auc = 0.653219
Epoch 315
Validation auc = 0.654473
Epoch 316
Loss = 2.1944e-03, PNorm = 91.0093, GNorm = 0.0634, lr_0 = 9.8557e-04
Validation auc = 0.657635
Epoch 317
Validation auc = 0.659598
Epoch 318
Validation auc = 0.660743
Epoch 319
Validation auc = 0.661015
Epoch 320
Loss = 1.1346e-02, PNorm = 91.0567, GNorm = 0.7436, lr_0 = 9.8534e-04
Loss = 1.6294e-03, PNorm = 91.0589, GNorm = 0.0471, lr_0 = 9.8532e-04
Validation auc = 0.663032
Epoch 321
Validation auc = 0.664831
Epoch 322
Validation auc = 0.665322
Epoch 323
Validation auc = 0.668429
Epoch 324
Validation auc = 0.691490
Epoch 325
Loss = 4.9926e-02, PNorm = 91.1374, GNorm = 1.4817, lr_0 = 9.8509e-04
Validation auc = 0.698141
Epoch 326
Validation auc = 0.695034
Epoch 327
Validation auc = 0.700485
Epoch 328
Validation auc = 0.700649
Epoch 329
Validation auc = 0.689091
Epoch 330
Loss = 1.1651e-02, PNorm = 91.5431, GNorm = 0.2089, lr_0 = 9.8483e-04
Validation auc = 0.676062
Epoch 331
Validation auc = 0.678133
Epoch 332
Validation auc = 0.677861
Epoch 333
Validation auc = 0.679605
Epoch 334
Loss = 7.1374e-02, PNorm = 91.9422, GNorm = 1.7855, lr_0 = 9.8461e-04
Loss = 1.3107e-02, PNorm = 91.9641, GNorm = 0.3341, lr_0 = 9.8459e-04
Validation auc = 0.685330
Epoch 335
Validation auc = 0.691326
Epoch 336
Validation auc = 0.694870
Epoch 337
Validation auc = 0.694325
Epoch 338
Validation auc = 0.690236
Epoch 339
Loss = 1.1857e-02, PNorm = 92.1998, GNorm = 0.3151, lr_0 = 9.8434e-04
Loss = 1.0121e+00, PNorm = 92.2104, GNorm = 4.0203, lr_0 = 9.8433e-04
Validation auc = 0.677370
Epoch 340
Validation auc = 0.662651
Epoch 341
Validation auc = 0.671264
Epoch 342
Validation auc = 0.671264
Epoch 343
Validation auc = 0.676879
Epoch 344
Loss = 6.2150e-02, PNorm = 92.3813, GNorm = 0.6834, lr_0 = 9.8410e-04
Validation auc = 0.684239
Epoch 345
Validation auc = 0.687020
Epoch 346
Validation auc = 0.683640
Epoch 347
Validation auc = 0.673336
Epoch 348
Validation auc = 0.674917
Epoch 349
Loss = 6.6536e-02, PNorm = 92.5983, GNorm = 1.1344, lr_0 = 9.8384e-04
Validation auc = 0.681132
Epoch 350
Validation auc = 0.702230
Epoch 351
Validation auc = 0.734994
Epoch 352
Validation auc = 0.726762
Epoch 353
Loss = 1.1131e-01, PNorm = 92.7958, GNorm = 1.9484, lr_0 = 9.8361e-04
Loss = 1.7203e-04, PNorm = 92.8165, GNorm = 0.0044, lr_0 = 9.8359e-04
Validation auc = 0.721856
Epoch 354
Validation auc = 0.719348
Epoch 355
Validation auc = 0.711170
Epoch 356
Validation auc = 0.703320
Epoch 357
Validation auc = 0.695361
Epoch 358
Loss = 2.1803e-02, PNorm = 93.0882, GNorm = 0.5056, lr_0 = 9.8335e-04
Validation auc = 0.686638
Epoch 359
Validation auc = 0.683749
Epoch 360
Validation auc = 0.682004
Epoch 361
Validation auc = 0.681786
Epoch 362
Validation auc = 0.677043
Epoch 363
Loss = 4.5158e-03, PNorm = 93.2351, GNorm = 0.0741, lr_0 = 9.8311e-04
Validation auc = 0.673663
Epoch 364
Validation auc = 0.669574
Epoch 365
Validation auc = 0.665758
Epoch 366
Validation auc = 0.660088
Epoch 367
Loss = 1.0283e-01, PNorm = 93.3723, GNorm = 0.9218, lr_0 = 9.8288e-04
Loss = 3.6197e-02, PNorm = 93.3838, GNorm = 0.6262, lr_0 = 9.8286e-04
Validation auc = 0.653110
Epoch 368
Validation auc = 0.647877
Epoch 369
Validation auc = 0.643842
Epoch 370
Validation auc = 0.644660
Epoch 371
Validation auc = 0.648149
Epoch 372
Loss = 2.1498e-02, PNorm = 93.5342, GNorm = 0.1083, lr_0 = 9.8262e-04
Loss = 2.9988e-03, PNorm = 93.5445, GNorm = 0.0593, lr_0 = 9.8260e-04
Validation auc = 0.650384
Epoch 373
Validation auc = 0.657744
Epoch 374
Validation auc = 0.673990
Epoch 375
Validation auc = 0.665322
Epoch 376
Validation auc = 0.652620
Epoch 377
Loss = 6.3828e-02, PNorm = 93.7001, GNorm = 1.1551, lr_0 = 9.8237e-04
Validation auc = 0.645859
Epoch 378
Validation auc = 0.642643
Epoch 379
Validation auc = 0.639808
Epoch 380
Validation auc = 0.638173
Epoch 381
Validation auc = 0.626452
Epoch 382
Loss = 9.0056e-03, PNorm = 94.0914, GNorm = 0.1613, lr_0 = 9.8211e-04
Validation auc = 0.609769
Epoch 383
Validation auc = 0.603445
Epoch 384
Validation auc = 0.598703
Epoch 385
Validation auc = 0.596685
Epoch 386
Loss = 1.1350e-02, PNorm = 94.3233, GNorm = 0.4926, lr_0 = 9.8189e-04
Loss = 2.7874e-02, PNorm = 94.3376, GNorm = 0.6362, lr_0 = 9.8187e-04
Validation auc = 0.593196
Epoch 387
Validation auc = 0.589707
Epoch 388
Validation auc = 0.586709
Epoch 389
Validation auc = 0.584637
Epoch 390
Validation auc = 0.588072
Epoch 391
Loss = 1.7345e-02, PNorm = 94.5030, GNorm = 0.3081, lr_0 = 9.8163e-04
Validation auc = 0.602083
Epoch 392
Validation auc = 0.604699
Epoch 393
Validation auc = 0.587472
Epoch 394
Validation auc = 0.577768
Epoch 395
Validation auc = 0.586818
Epoch 396
Loss = 4.9586e-03, PNorm = 94.6928, GNorm = 0.1208, lr_0 = 9.8138e-04
Validation auc = 0.590907
Epoch 397
Validation auc = 0.594668
Epoch 398
Validation auc = 0.602137
Epoch 399
Validation auc = 0.609769
Epoch 400
Loss = 2.0377e-02, PNorm = 94.8612, GNorm = 0.3993, lr_0 = 9.8116e-04
Loss = 1.9942e-03, PNorm = 94.8765, GNorm = 0.0515, lr_0 = 9.8114e-04
Validation auc = 0.619637
Epoch 401
Validation auc = 0.623399
Epoch 402
Validation auc = 0.627215
Epoch 403
Validation auc = 0.629995
Epoch 404
Validation auc = 0.629723
Epoch 405
Loss = 6.1877e-03, PNorm = 95.0512, GNorm = 0.0830, lr_0 = 9.8089e-04
Loss = 4.2787e-03, PNorm = 95.0619, GNorm = 0.2050, lr_0 = 9.8088e-04
Validation auc = 0.628632
Epoch 406
Validation auc = 0.625579
Epoch 407
Validation auc = 0.622308
Epoch 408
Validation auc = 0.620727
Epoch 409
Validation auc = 0.616420
Epoch 410
Loss = 7.3841e-03, PNorm = 95.1772, GNorm = 0.1504, lr_0 = 9.8065e-04
Validation auc = 0.612550
Epoch 411
Validation auc = 0.608079
Epoch 412
Validation auc = 0.605463
Epoch 413
Validation auc = 0.604263
Epoch 414
Validation auc = 0.602900
Epoch 415
Loss = 2.1293e-03, PNorm = 95.2631, GNorm = 0.0443, lr_0 = 9.8039e-04
Validation auc = 0.601156
Epoch 416
Validation auc = 0.610478
Epoch 417
Validation auc = 0.647822
Epoch 418
Validation auc = 0.656926
Epoch 419
Loss = 4.2639e-01, PNorm = 95.4553, GNorm = 6.2251, lr_0 = 9.8016e-04
Loss = 1.7350e-03, PNorm = 95.4830, GNorm = 0.0371, lr_0 = 9.8015e-04
Validation auc = 0.665104
Epoch 420
Validation auc = 0.658671
Epoch 421
Validation auc = 0.649512
Epoch 422
Validation auc = 0.630268
Epoch 423
Validation auc = 0.583983
Epoch 424
Loss = 6.4072e-02, PNorm = 95.9654, GNorm = 1.0442, lr_0 = 9.7990e-04
Validation auc = 0.567901
Epoch 425
Validation auc = 0.619691
Epoch 426
Validation auc = 0.639208
Epoch 427
Validation auc = 0.646078
Epoch 428
Validation auc = 0.652947
Epoch 429
Loss = 1.1393e-01, PNorm = 96.3270, GNorm = 0.8105, lr_0 = 9.7966e-04
Validation auc = 0.658943
Epoch 430
Validation auc = 0.657799
Epoch 431
Validation auc = 0.658289
Epoch 432
Validation auc = 0.658344
Epoch 433
Loss = 1.4855e-02, PNorm = 96.5056, GNorm = 0.6677, lr_0 = 9.7942e-04
Validation auc = 0.655454
Epoch 434
Validation auc = 0.656763
Epoch 435
Validation auc = 0.658398
Epoch 436
Validation auc = 0.666358
Epoch 437
Validation auc = 0.670665
Epoch 438
Loss = 1.9003e-02, PNorm = 96.6056, GNorm = 0.7900, lr_0 = 9.7917e-04
Loss = 3.4265e-03, PNorm = 96.6116, GNorm = 0.0843, lr_0 = 9.7916e-04
Validation auc = 0.672137
Epoch 439
Validation auc = 0.670337
Epoch 440
Validation auc = 0.669084
Epoch 441
Validation auc = 0.665758
Epoch 442
Validation auc = 0.655182
Epoch 443
Loss = 6.8637e-02, PNorm = 96.6944, GNorm = 0.9189, lr_0 = 9.7893e-04
Validation auc = 0.653165
Epoch 444
Validation auc = 0.659052
Epoch 445
Validation auc = 0.673281
Epoch 446
Validation auc = 0.703320
Epoch 447
Validation auc = 0.677915
Epoch 448
Loss = 6.8923e-02, PNorm = 96.9642, GNorm = 2.1380, lr_0 = 9.7867e-04
Validation auc = 0.672518
Epoch 449
Validation auc = 0.663141
Epoch 450
Validation auc = 0.652238
Epoch 451
Validation auc = 0.656763
Epoch 452
Loss = 4.0805e-02, PNorm = 97.4556, GNorm = 0.5633, lr_0 = 9.7845e-04
Loss = 1.7726e-01, PNorm = 97.4912, GNorm = 4.5290, lr_0 = 9.7843e-04
Validation auc = 0.663032
Epoch 453
Validation auc = 0.650112
Epoch 454
Validation auc = 0.644551
Epoch 455
Validation auc = 0.645587
Epoch 456
Validation auc = 0.641226
Epoch 457
Loss = 8.3672e-02, PNorm = 97.9032, GNorm = 2.1664, lr_0 = 9.7819e-04
Loss = 9.9671e-02, PNorm = 97.9348, GNorm = 5.3310, lr_0 = 9.7817e-04
Validation auc = 0.635556
Epoch 458
Validation auc = 0.639754
Epoch 459
Validation auc = 0.652183
Epoch 460
Validation auc = 0.672355
Epoch 461
Validation auc = 0.674971
Epoch 462
Loss = 2.3812e-02, PNorm = 98.3415, GNorm = 0.6210, lr_0 = 9.7794e-04
Validation auc = 0.676934
Epoch 463
Validation auc = 0.679006
Epoch 464
Validation auc = 0.679333
Epoch 465
Validation auc = 0.678569
Epoch 466
Loss = 1.8470e-02, PNorm = 98.6949, GNorm = 0.1343, lr_0 = 9.7770e-04
Validation auc = 0.676171
Epoch 467
Validation auc = 0.667175
Epoch 468
Validation auc = 0.660906
Epoch 469
Validation auc = 0.660197
Epoch 470
Validation auc = 0.660088
Epoch 471
Loss = 3.5050e-02, PNorm = 98.8580, GNorm = 0.2505, lr_0 = 9.7746e-04
Loss = 1.9303e-03, PNorm = 98.8660, GNorm = 0.0739, lr_0 = 9.7744e-04
Validation auc = 0.662705
Epoch 472
Validation auc = 0.665813
Epoch 473
Validation auc = 0.668756
Epoch 474
Validation auc = 0.669847
Epoch 475
Validation auc = 0.670883
Epoch 476
Loss = 3.0491e-03, PNorm = 98.9537, GNorm = 0.0506, lr_0 = 9.7721e-04
Validation auc = 0.673172
Epoch 477
Validation auc = 0.675135
Epoch 478
Validation auc = 0.677098
Epoch 479
Validation auc = 0.678079
Epoch 480
Validation auc = 0.677425
Epoch 481
Loss = 3.1605e-03, PNorm = 99.0279, GNorm = 0.0656, lr_0 = 9.7695e-04
Validation auc = 0.677697
Epoch 482
Validation auc = 0.678679
Epoch 483
Validation auc = 0.678297
Epoch 484
Validation auc = 0.675735
Epoch 485
Loss = 1.4998e-03, PNorm = 99.0758, GNorm = 0.0416, lr_0 = 9.7673e-04
Loss = 1.3361e-02, PNorm = 99.0799, GNorm = 0.6209, lr_0 = 9.7671e-04
Validation auc = 0.674481
Epoch 486
Validation auc = 0.676280
Epoch 487
Validation auc = 0.667666
Epoch 488
Validation auc = 0.661560
Epoch 489
Validation auc = 0.657417
Epoch 490
Loss = 4.1435e-02, PNorm = 99.1337, GNorm = 0.1471, lr_0 = 9.7647e-04
Loss = 2.2022e-03, PNorm = 99.1369, GNorm = 0.0626, lr_0 = 9.7645e-04
Validation auc = 0.652620
Epoch 491
Validation auc = 0.647986
Epoch 492
Validation auc = 0.650330
Epoch 493
Validation auc = 0.657744
Epoch 494
Validation auc = 0.662705
Epoch 495
Loss = 7.7416e-03, PNorm = 99.1894, GNorm = 0.2500, lr_0 = 9.7623e-04
Validation auc = 0.664395
Epoch 496
Validation auc = 0.661506
Epoch 497
Validation auc = 0.660906
Epoch 498
Validation auc = 0.659652
Epoch 499
Loss = 6.5981e-03, PNorm = 99.2358, GNorm = 0.0510, lr_0 = 9.7599e-04
Validation auc = 0.661179
Epoch 500
Validation auc = 0.661669
Epoch 501
Validation auc = 0.662324
Epoch 502
Validation auc = 0.664504
Epoch 503
Validation auc = 0.666630
Epoch 504
Loss = 4.1569e-03, PNorm = 99.2547, GNorm = 0.0216, lr_0 = 9.7574e-04
Loss = 5.1975e-04, PNorm = 99.2557, GNorm = 0.0129, lr_0 = 9.7573e-04
Validation auc = 0.666521
Epoch 505
Validation auc = 0.667066
Epoch 506
Validation auc = 0.666794
Epoch 507
Validation auc = 0.665595
Epoch 508
Validation auc = 0.664886
Epoch 509
Loss = 1.4616e-03, PNorm = 99.2683, GNorm = 0.0231, lr_0 = 9.7550e-04
Validation auc = 0.665104
Epoch 510
Validation auc = 0.665813
Epoch 511
Validation auc = 0.665704
Epoch 512
Validation auc = 0.663250
Epoch 513
Validation auc = 0.660688
Epoch 514
Loss = 4.3295e-03, PNorm = 99.2723, GNorm = 0.0969, lr_0 = 9.7524e-04
Validation auc = 0.658344
Epoch 515
Validation auc = 0.656109
Epoch 516
Validation auc = 0.655345
Epoch 517
Validation auc = 0.652892
Epoch 518
Loss = 2.0243e-03, PNorm = 99.3058, GNorm = 0.2485, lr_0 = 9.7502e-04
Loss = 4.1475e-03, PNorm = 99.3088, GNorm = 0.3097, lr_0 = 9.7500e-04
Validation auc = 0.649021
Epoch 519
Validation auc = 0.646732
Epoch 520
Validation auc = 0.645423
Epoch 521
Validation auc = 0.643733
Epoch 522
Validation auc = 0.641389
Epoch 523
Loss = 1.2797e-03, PNorm = 99.3413, GNorm = 0.0234, lr_0 = 9.7476e-04
Loss = 1.5623e-03, PNorm = 99.3431, GNorm = 0.0431, lr_0 = 9.7474e-04
Validation auc = 0.640462
Epoch 524
Validation auc = 0.639481
Epoch 525
Validation auc = 0.636973
Epoch 526
Validation auc = 0.634574
Epoch 527
Validation auc = 0.634247
Epoch 528
Loss = 7.1650e-04, PNorm = 99.3661, GNorm = 0.0129, lr_0 = 9.7452e-04
Validation auc = 0.635011
Epoch 529
Validation auc = 0.635229
Epoch 530
Validation auc = 0.635065
Epoch 531
Validation auc = 0.635610
Epoch 532
Validation auc = 0.634193
Epoch 533
Loss = 7.8568e-04, PNorm = 99.3772, GNorm = 0.0193, lr_0 = 9.7426e-04
Validation auc = 0.633866
Epoch 534
Validation auc = 0.633484
Epoch 535
Validation auc = 0.632775
Epoch 536
Validation auc = 0.632067
Epoch 537
Loss = 2.8576e-03, PNorm = 99.3840, GNorm = 0.0138, lr_0 = 9.7403e-04
Loss = 3.4760e-03, PNorm = 99.3847, GNorm = 0.2311, lr_0 = 9.7401e-04
Validation auc = 0.631849
Epoch 538
Validation auc = 0.632012
Epoch 539
Validation auc = 0.632285
Epoch 540
Validation auc = 0.632721
Epoch 541
Validation auc = 0.632612
Epoch 542
Loss = 9.7469e-04, PNorm = 99.3942, GNorm = 0.0291, lr_0 = 9.7379e-04
Validation auc = 0.631631
Epoch 543
Validation auc = 0.629450
Epoch 544
Validation auc = 0.628196
Epoch 545
Validation auc = 0.600829
Epoch 546
Validation auc = 0.588508
Epoch 547
Loss = 2.8939e-02, PNorm = 99.4061, GNorm = 1.3646, lr_0 = 9.7353e-04
Validation auc = 0.656163
Epoch 548
Validation auc = 0.689582
Epoch 549
Validation auc = 0.698468
Epoch 550
Validation auc = 0.700213
Epoch 551
Loss = 2.5632e-02, PNorm = 99.4559, GNorm = 0.2395, lr_0 = 9.7331e-04
Loss = 2.9045e-04, PNorm = 99.4606, GNorm = 0.0129, lr_0 = 9.7329e-04
Validation auc = 0.700649
Epoch 552
Validation auc = 0.699395
Epoch 553
Validation auc = 0.698795
Epoch 554
Validation auc = 0.698523
Epoch 555
Validation auc = 0.697814
Epoch 556
Loss = 2.9017e-03, PNorm = 99.5159, GNorm = 0.0507, lr_0 = 9.7305e-04
Loss = 4.9225e-04, PNorm = 99.5189, GNorm = 0.0184, lr_0 = 9.7303e-04
Validation auc = 0.696778
Epoch 557
Validation auc = 0.695851
Epoch 558
Validation auc = 0.695088
Epoch 559
Validation auc = 0.693889
Epoch 560
Validation auc = 0.692090
Epoch 561
Loss = 3.6754e-04, PNorm = 99.5474, GNorm = 0.0074, lr_0 = 9.7281e-04
Validation auc = 0.690890
Epoch 562
Validation auc = 0.689037
Epoch 563
Validation auc = 0.688055
Epoch 564
Validation auc = 0.687783
Epoch 565
Validation auc = 0.687783
Epoch 566
Loss = 6.2953e-04, PNorm = 99.5651, GNorm = 0.0177, lr_0 = 9.7255e-04
Validation auc = 0.687837
Epoch 567
Validation auc = 0.685439
Epoch 568
Validation auc = 0.669465
Epoch 569
Validation auc = 0.652074
Epoch 570
Loss = 1.8155e-02, PNorm = 99.6451, GNorm = 0.4709, lr_0 = 9.7232e-04
Loss = 1.7514e-03, PNorm = 99.6570, GNorm = 0.0670, lr_0 = 9.7231e-04
Validation auc = 0.631740
Epoch 571
Validation auc = 0.608516
Epoch 572
Validation auc = 0.598703
Epoch 573
Validation auc = 0.594505
Epoch 574
Validation auc = 0.593305
Epoch 575
Loss = 1.8728e-03, PNorm = 99.7567, GNorm = 0.0482, lr_0 = 9.7208e-04
Validation auc = 0.591179
Epoch 576
Validation auc = 0.588835
Epoch 577
Validation auc = 0.588453
Epoch 578
Validation auc = 0.588181
Epoch 579
Validation auc = 0.590580
Epoch 580
Loss = 9.4474e-04, PNorm = 99.8080, GNorm = 0.0208, lr_0 = 9.7182e-04
Validation auc = 0.591397
Epoch 581
Validation auc = 0.595486
Epoch 582
Validation auc = 0.599738
Epoch 583
Validation auc = 0.603882
Epoch 584
Loss = 1.7686e-03, PNorm = 99.8643, GNorm = 0.0317, lr_0 = 9.7160e-04
Loss = 7.6399e-04, PNorm = 99.8677, GNorm = 0.0216, lr_0 = 9.7158e-04
Validation auc = 0.608297
Epoch 585
Validation auc = 0.611187
Epoch 586
Validation auc = 0.613913
Epoch 587
Validation auc = 0.616039
Epoch 588
Validation auc = 0.616966
Epoch 589
Loss = 9.9961e-04, PNorm = 99.8986, GNorm = 0.0966, lr_0 = 9.7134e-04
Loss = 3.2012e-04, PNorm = 99.8999, GNorm = 0.0268, lr_0 = 9.7132e-04
Validation auc = 0.617565
Epoch 590
Validation auc = 0.618383
Epoch 591
Validation auc = 0.618383
Epoch 592
Validation auc = 0.618383
Epoch 593
Validation auc = 0.618765
Epoch 594
Loss = 1.1599e-01, PNorm = 99.9088, GNorm = 0.7682, lr_0 = 9.7110e-04
Validation auc = 0.621490
Epoch 595
Validation auc = 0.624652
Epoch 596
Validation auc = 0.631740
Epoch 597
Validation auc = 0.635283
Epoch 598
Validation auc = 0.633648
Epoch 599
Loss = 1.1838e-03, PNorm = 99.9579, GNorm = 0.0380, lr_0 = 9.7084e-04
Validation auc = 0.631958
Epoch 600
Validation auc = 0.630813
Epoch 601
Validation auc = 0.630813
Epoch 602
Validation auc = 0.632121
Epoch 603
Loss = 1.4367e-02, PNorm = 100.0269, GNorm = 0.0572, lr_0 = 9.7062e-04
Loss = 1.1002e-03, PNorm = 100.0305, GNorm = 0.0549, lr_0 = 9.7060e-04
Validation auc = 0.630976
Epoch 604
Validation auc = 0.630322
Epoch 605
Validation auc = 0.629886
Epoch 606
Validation auc = 0.630595
Epoch 607
Validation auc = 0.631085
Epoch 608
Loss = 9.8219e-04, PNorm = 100.0611, GNorm = 0.0056, lr_0 = 9.7036e-04
Validation auc = 0.630213
Epoch 609
Validation auc = 0.632230
Epoch 610
Validation auc = 0.634902
Epoch 611
Validation auc = 0.636864
Epoch 612
Validation auc = 0.634465
Epoch 613
Loss = 7.5854e-04, PNorm = 100.0801, GNorm = 0.0225, lr_0 = 9.7012e-04
Validation auc = 0.633157
Epoch 614
Validation auc = 0.631740
Epoch 615
Validation auc = 0.632994
Epoch 616
Validation auc = 0.634084
Epoch 617
Loss = 4.0214e-03, PNorm = 100.0953, GNorm = 0.0578, lr_0 = 9.6990e-04
Loss = 5.7014e-05, PNorm = 100.0967, GNorm = 0.0032, lr_0 = 9.6988e-04
Validation auc = 0.631358
Epoch 618
Validation auc = 0.629068
Epoch 619
Validation auc = 0.628142
Epoch 620
Validation auc = 0.626942
Epoch 621
Validation auc = 0.626124
Epoch 622
Loss = 5.6650e-04, PNorm = 100.1129, GNorm = 0.0122, lr_0 = 9.6964e-04
Loss = 8.7756e-04, PNorm = 100.1139, GNorm = 0.0350, lr_0 = 9.6962e-04
Validation auc = 0.625307
Epoch 623
Validation auc = 0.624652
Epoch 624
Validation auc = 0.623562
Epoch 625
Validation auc = 0.622744
Epoch 626
Validation auc = 0.618547
Epoch 627
Loss = 7.9664e-02, PNorm = 100.1306, GNorm = 0.6477, lr_0 = 9.6940e-04
Validation auc = 0.613967
Epoch 628
Validation auc = 0.612550
Epoch 629
Validation auc = 0.611896
Epoch 630
Validation auc = 0.610587
Epoch 631
Validation auc = 0.610914
Epoch 632
Loss = 1.8615e-03, PNorm = 100.1628, GNorm = 0.0616, lr_0 = 9.6914e-04
Validation auc = 0.611296
Epoch 633
Validation auc = 0.612550
Epoch 634
Validation auc = 0.612495
Epoch 635
Validation auc = 0.613477
Epoch 636
Loss = 1.6018e-03, PNorm = 100.1887, GNorm = 0.0029, lr_0 = 9.6892e-04
Loss = 9.1759e-05, PNorm = 100.1901, GNorm = 0.0031, lr_0 = 9.6890e-04
Validation auc = 0.614349
Epoch 637
Validation auc = 0.615276
Epoch 638
Validation auc = 0.616966
Epoch 639
Validation auc = 0.619419
Epoch 640
Validation auc = 0.621272
Epoch 641
Loss = 2.8781e-04, PNorm = 100.2010, GNorm = 0.0081, lr_0 = 9.6866e-04
Validation auc = 0.622308
Epoch 642
Validation auc = 0.606171
Epoch 643
Validation auc = 0.625852
Epoch 644
Validation auc = 0.643079
Epoch 645
Validation auc = 0.651366
Epoch 646
Loss = 5.1176e-04, PNorm = 100.2125, GNorm = 0.0108, lr_0 = 9.6842e-04
Validation auc = 0.656054
Epoch 647
Validation auc = 0.658180
Epoch 648
Validation auc = 0.659761
Epoch 649
Validation auc = 0.660524
Epoch 650
Loss = 4.5653e-04, PNorm = 100.2221, GNorm = 0.0064, lr_0 = 9.6820e-04
Loss = 2.3385e-04, PNorm = 100.2228, GNorm = 0.0085, lr_0 = 9.6818e-04
Validation auc = 0.661015
Epoch 651
Validation auc = 0.661778
Epoch 652
Validation auc = 0.661942
Epoch 653
Validation auc = 0.661615
Epoch 654
Validation auc = 0.661179
Epoch 655
Loss = 3.3802e-04, PNorm = 100.2356, GNorm = 0.0054, lr_0 = 9.6794e-04
Loss = 4.1162e-05, PNorm = 100.2362, GNorm = 0.0014, lr_0 = 9.6792e-04
Validation auc = 0.661397
Epoch 656
Validation auc = 0.661124
Epoch 657
Validation auc = 0.661070
Epoch 658
Validation auc = 0.660906
Epoch 659
Validation auc = 0.663032
Epoch 660
Loss = 2.8657e-04, PNorm = 100.2461, GNorm = 0.0056, lr_0 = 9.6770e-04
Validation auc = 0.664395
Epoch 661
Validation auc = 0.665267
Epoch 662
Validation auc = 0.665322
Epoch 663
Validation auc = 0.666085
Epoch 664
Validation auc = 0.666194
Epoch 665
Loss = 4.7425e-04, PNorm = 100.2614, GNorm = 0.0097, lr_0 = 9.6744e-04
Validation auc = 0.666249
Epoch 666
Validation auc = 0.666140
Epoch 667
Validation auc = 0.666685
Epoch 668
Validation auc = 0.666576
Epoch 669
Loss = 2.8532e-04, PNorm = 100.2722, GNorm = 0.0088, lr_0 = 9.6722e-04
Loss = 5.0522e-04, PNorm = 100.2729, GNorm = 0.0141, lr_0 = 9.6720e-04
Validation auc = 0.667285
Epoch 670
Validation auc = 0.667285
Epoch 671
Validation auc = 0.667394
Epoch 672
Validation auc = 0.672355
Epoch 673
Validation auc = 0.673227
Epoch 674
Loss = 1.3416e-01, PNorm = 100.3301, GNorm = 1.7204, lr_0 = 9.6696e-04
Validation auc = 0.682168
Epoch 675
Validation auc = 0.684076
Epoch 676
Validation auc = 0.689309
Epoch 677
Validation auc = 0.687456
Epoch 678
Validation auc = 0.683585
Epoch 679
Loss = 4.9023e-02, PNorm = 101.2016, GNorm = 0.5588, lr_0 = 9.6672e-04
Validation auc = 0.669847
Epoch 680
Validation auc = 0.687892
Epoch 681
Validation auc = 0.686965
Epoch 682
Validation auc = 0.658834
Epoch 683
Loss = 1.2690e-01, PNorm = 102.1514, GNorm = 0.8041, lr_0 = 9.6648e-04
Validation auc = 0.649839
Epoch 684
Validation auc = 0.660688
Epoch 685
Validation auc = 0.666031
Epoch 686
Validation auc = 0.690509
Epoch 687
Validation auc = 0.667666
Epoch 688
Loss = 2.2179e-01, PNorm = 103.2371, GNorm = 0.8351, lr_0 = 9.6624e-04
Loss = 3.9466e-01, PNorm = 103.3234, GNorm = 3.0635, lr_0 = 9.6622e-04
Validation auc = 0.663741
Epoch 689
Validation auc = 0.682277
Epoch 690
Validation auc = 0.699013
Epoch 691
Validation auc = 0.685057
Epoch 692
Validation auc = 0.655509
Epoch 693
Loss = 8.4299e-02, PNorm = 104.1831, GNorm = 0.9307, lr_0 = 9.6600e-04
Validation auc = 0.612659
Epoch 694
Validation auc = 0.625089
Epoch 695
Validation auc = 0.652620
Epoch 696
Validation auc = 0.666794
Epoch 697
Validation auc = 0.675953
Epoch 698
Loss = 4.5613e-02, PNorm = 104.7427, GNorm = 1.1042, lr_0 = 9.6574e-04
Validation auc = 0.690018
Epoch 699
Validation auc = 0.691817
Epoch 700
Validation auc = 0.681241
Epoch 701
Validation auc = 0.662433
Epoch 702
Loss = 6.4775e-02, PNorm = 105.0250, GNorm = 2.7228, lr_0 = 9.6552e-04
Loss = 9.8229e-03, PNorm = 105.0406, GNorm = 0.2697, lr_0 = 9.6550e-04
Validation auc = 0.677861
Epoch 703
Validation auc = 0.677861
Epoch 704
Validation auc = 0.669629
Epoch 705
Validation auc = 0.654855
Epoch 706
Validation auc = 0.636973
Epoch 707
Loss = 8.0740e-02, PNorm = 105.2788, GNorm = 1.6494, lr_0 = 9.6526e-04
Loss = 1.1193e-01, PNorm = 105.2963, GNorm = 3.6702, lr_0 = 9.6525e-04
Validation auc = 0.634847
Epoch 708
Validation auc = 0.635883
Epoch 709
Validation auc = 0.633103
Epoch 710
Validation auc = 0.641117
Epoch 711
Validation auc = 0.641989
Epoch 712
Loss = 4.8384e-02, PNorm = 105.5853, GNorm = 0.6799, lr_0 = 9.6502e-04
Validation auc = 0.636374
Epoch 713
Validation auc = 0.637191
Epoch 714
Validation auc = 0.636973
Epoch 715
Validation auc = 0.637028
Epoch 716
Loss = 2.6756e-02, PNorm = 105.7937, GNorm = 0.0694, lr_0 = 9.6479e-04
Validation auc = 0.644006
Epoch 717
Validation auc = 0.651148
Epoch 718
Validation auc = 0.656109
Epoch 719
Validation auc = 0.656327
Epoch 720
Validation auc = 0.658180
Epoch 721
Loss = 1.1216e-02, PNorm = 105.9204, GNorm = 0.3400, lr_0 = 9.6455e-04
Loss = 4.1634e-03, PNorm = 105.9283, GNorm = 0.0906, lr_0 = 9.6453e-04
Validation auc = 0.656708
Epoch 722
Validation auc = 0.658725
Epoch 723
Validation auc = 0.654746
Epoch 724
Validation auc = 0.652129
Epoch 725
Validation auc = 0.644333
Epoch 726
Loss = 9.2007e-03, PNorm = 106.0839, GNorm = 0.1655, lr_0 = 9.6431e-04
Validation auc = 0.638990
Epoch 727
Validation auc = 0.641280
Epoch 728
Validation auc = 0.656490
Epoch 729
Validation auc = 0.667285
Epoch 730
Validation auc = 0.666903
Epoch 731
Loss = 3.4187e-02, PNorm = 106.2976, GNorm = 0.4258, lr_0 = 9.6405e-04
Validation auc = 0.665922
Epoch 732
Validation auc = 0.663359
Epoch 733
Validation auc = 0.667557
Epoch 734
Validation auc = 0.672409
Epoch 735
Loss = 2.4436e-02, PNorm = 106.4883, GNorm = 0.3222, lr_0 = 9.6383e-04
Loss = 7.7308e-03, PNorm = 106.4994, GNorm = 0.1784, lr_0 = 9.6381e-04
Validation auc = 0.674154
Epoch 736
Validation auc = 0.665867
Epoch 737
Validation auc = 0.654746
Epoch 738
Validation auc = 0.662542
Epoch 739
Validation auc = 0.671646
Epoch 740
Loss = 1.7397e-02, PNorm = 106.6389, GNorm = 0.2093, lr_0 = 9.6357e-04
Loss = 2.0234e-03, PNorm = 106.6480, GNorm = 0.0664, lr_0 = 9.6355e-04
Validation auc = 0.676389
Epoch 741
Validation auc = 0.681350
Epoch 742
Validation auc = 0.680314
Epoch 743
Validation auc = 0.674263
Epoch 744
Validation auc = 0.670283
Epoch 745
Loss = 4.8252e-03, PNorm = 106.7238, GNorm = 0.1690, lr_0 = 9.6333e-04
Validation auc = 0.664395
Epoch 746
Validation auc = 0.665649
Epoch 747
Validation auc = 0.678569
Epoch 748
Validation auc = 0.670610
Epoch 749
Loss = 3.9923e-03, PNorm = 106.7753, GNorm = 0.0100, lr_0 = 9.6309e-04
Validation auc = 0.661397
Epoch 750
Validation auc = 0.653110
Epoch 751
Validation auc = 0.654310
Epoch 752
Validation auc = 0.653492
Epoch 753
Validation auc = 0.637464
Epoch 754
Loss = 3.4731e-02, PNorm = 107.0774, GNorm = 1.0208, lr_0 = 9.6285e-04
Loss = 6.0689e-02, PNorm = 107.0944, GNorm = 2.5901, lr_0 = 9.6284e-04
Validation auc = 0.644442
Epoch 755
Validation auc = 0.652074
Epoch 756
Validation auc = 0.642588
Epoch 757
Validation auc = 0.663577
Epoch 758
Validation auc = 0.662814
Epoch 759
Loss = 6.4248e-02, PNorm = 107.3652, GNorm = 1.4792, lr_0 = 9.6262e-04
Validation auc = 0.656000
Epoch 760
Validation auc = 0.663632
Epoch 761
Validation auc = 0.677316
Epoch 762
Validation auc = 0.671591
Epoch 763
Validation auc = 0.661070
Epoch 764
Loss = 2.5992e-02, PNorm = 107.8214, GNorm = 0.4693, lr_0 = 9.6236e-04
Validation auc = 0.654746
Epoch 765
Validation auc = 0.652674
Epoch 766
Validation auc = 0.646078
Epoch 767
Validation auc = 0.648694
Epoch 768
Loss = 1.6437e-02, PNorm = 108.1083, GNorm = 0.3963, lr_0 = 9.6214e-04
Loss = 2.3670e-03, PNorm = 108.1280, GNorm = 0.0647, lr_0 = 9.6212e-04
Validation auc = 0.650984
Epoch 769
Validation auc = 0.649403
Epoch 770
Validation auc = 0.643624
Epoch 771
Validation auc = 0.640299
Epoch 772
Validation auc = 0.641007
Epoch 773
Loss = 8.6780e-03, PNorm = 108.3306, GNorm = 0.2154, lr_0 = 9.6188e-04
Loss = 4.1491e-03, PNorm = 108.3419, GNorm = 0.1267, lr_0 = 9.6186e-04
Validation auc = 0.647604
Epoch 774
Validation auc = 0.639208
Epoch 775
Validation auc = 0.618219
Epoch 776
Validation auc = 0.603118
Epoch 777
Validation auc = 0.594232
Epoch 778
Loss = 1.2066e-01, PNorm = 108.4484, GNorm = 0.8145, lr_0 = 9.6164e-04
Validation auc = 0.591288
Epoch 779
Validation auc = 0.582620
Epoch 780
Validation auc = 0.595486
Epoch 781
Validation auc = 0.605953
Epoch 782
Validation auc = 0.616148
Epoch 783
Loss = 1.4220e-02, PNorm = 108.6569, GNorm = 0.2484, lr_0 = 9.6139e-04
Validation auc = 0.620836
Epoch 784
Validation auc = 0.623399
Epoch 785
Validation auc = 0.618110
Epoch 786
Validation auc = 0.613477
Epoch 787
Loss = 9.6488e-02, PNorm = 108.7893, GNorm = 2.0731, lr_0 = 9.6117e-04
Loss = 7.8363e-03, PNorm = 108.7972, GNorm = 0.2195, lr_0 = 9.6115e-04
Validation auc = 0.616257
Epoch 788
Validation auc = 0.620564
Epoch 789
Validation auc = 0.620782
Epoch 790
Validation auc = 0.621163
Epoch 791
Validation auc = 0.622254
Epoch 792
Loss = 4.4164e-03, PNorm = 108.8917, GNorm = 0.1476, lr_0 = 9.6093e-04
Validation auc = 0.624216
Epoch 793
Validation auc = 0.629723
Epoch 794
Validation auc = 0.640789
Epoch 795
Validation auc = 0.649948
Epoch 796
Validation auc = 0.652838
Epoch 797
Loss = 7.1108e-02, PNorm = 108.9544, GNorm = 1.8790, lr_0 = 9.6067e-04
Validation auc = 0.653383
Epoch 798
Validation auc = 0.648858
Epoch 799
Validation auc = 0.640026
Epoch 800
Validation auc = 0.631413
Epoch 801
Loss = 4.8113e-02, PNorm = 109.0022, GNorm = 2.1281, lr_0 = 9.6045e-04
Loss = 2.3003e-02, PNorm = 109.0088, GNorm = 0.6252, lr_0 = 9.6043e-04
Validation auc = 0.633266
Epoch 802
Validation auc = 0.636210
Epoch 803
Validation auc = 0.638663
Epoch 804
Validation auc = 0.640626
Epoch 805
Validation auc = 0.643025
Epoch 806
Loss = 5.6899e-03, PNorm = 109.1042, GNorm = 0.0658, lr_0 = 9.6019e-04
Loss = 5.8826e-04, PNorm = 109.1097, GNorm = 0.0151, lr_0 = 9.6018e-04
Validation auc = 0.644006
Epoch 807
Validation auc = 0.645369
Epoch 808
Validation auc = 0.648803
Epoch 809
Validation auc = 0.654037
Epoch 810
Validation auc = 0.657253
Epoch 811
Loss = 9.1618e-03, PNorm = 109.1642, GNorm = 0.3066, lr_0 = 9.5996e-04
Validation auc = 0.654746
Epoch 812
Validation auc = 0.649239
Epoch 813
Validation auc = 0.646296
Epoch 814
Validation auc = 0.647331
Epoch 815
Validation auc = 0.647713
Epoch 816
Loss = 1.1220e-03, PNorm = 109.2289, GNorm = 0.0174, lr_0 = 9.5970e-04
Validation auc = 0.648422
Epoch 817
Validation auc = 0.638118
Epoch 818
Validation auc = 0.622908
Epoch 819
Validation auc = 0.633920
Epoch 820
Loss = 2.7497e-02, PNorm = 109.2841, GNorm = 0.0458, lr_0 = 9.5948e-04
Loss = 9.0284e-04, PNorm = 109.2890, GNorm = 0.0406, lr_0 = 9.5946e-04
Validation auc = 0.658344
Epoch 821
Validation auc = 0.670119
Epoch 822
Validation auc = 0.675517
Epoch 823
Validation auc = 0.675898
Epoch 824
Validation auc = 0.676062
Epoch 825
Loss = 2.2468e-03, PNorm = 109.3443, GNorm = 0.0474, lr_0 = 9.5924e-04
Validation auc = 0.675571
Epoch 826
Validation auc = 0.675898
Epoch 827
Validation auc = 0.675517
Epoch 828
Validation auc = 0.675026
Epoch 829
Validation auc = 0.675626
Epoch 830
Loss = 1.1176e-02, PNorm = 109.3844, GNorm = 0.2397, lr_0 = 9.5899e-04
Validation auc = 0.676007
Epoch 831
Validation auc = 0.677043
Epoch 832
Validation auc = 0.676552
Epoch 833
Validation auc = 0.676225
Epoch 834
Loss = 4.6734e-02, PNorm = 109.4072, GNorm = 0.8247, lr_0 = 9.5877e-04
Loss = 3.6148e-04, PNorm = 109.4101, GNorm = 0.0136, lr_0 = 9.5875e-04
Validation auc = 0.672573
Epoch 835
Validation auc = 0.669629
Epoch 836
Validation auc = 0.666140
Epoch 837
Validation auc = 0.663577
Epoch 838
Validation auc = 0.658126
Epoch 839
Loss = 2.2433e-02, PNorm = 109.4856, GNorm = 0.0212, lr_0 = 9.5851e-04
Loss = 1.0504e-03, PNorm = 109.4930, GNorm = 0.0582, lr_0 = 9.5849e-04
Validation auc = 0.657472
Epoch 840
Validation auc = 0.655945
Epoch 841
Validation auc = 0.655127
Epoch 842
Validation auc = 0.653492
Epoch 843
Validation auc = 0.652456
Epoch 844
Loss = 5.3798e-03, PNorm = 109.5594, GNorm = 0.1360, lr_0 = 9.5827e-04
Validation auc = 0.651093
Epoch 845
Validation auc = 0.648858
Epoch 846
Validation auc = 0.648367
Epoch 847
Validation auc = 0.647713
Epoch 848
Validation auc = 0.647168
Epoch 849
Loss = 4.9411e-03, PNorm = 109.5981, GNorm = 0.4597, lr_0 = 9.5802e-04
Validation auc = 0.647113
Epoch 850
Validation auc = 0.646078
Epoch 851
Validation auc = 0.645587
Epoch 852
Validation auc = 0.646514
Epoch 853
Loss = 4.8816e-03, PNorm = 109.6186, GNorm = 0.5160, lr_0 = 9.5780e-04
Loss = 1.8038e-03, PNorm = 109.6200, GNorm = 0.0644, lr_0 = 9.5778e-04
Validation auc = 0.648749
Epoch 854
Validation auc = 0.649512
Epoch 855
Validation auc = 0.651802
Epoch 856
Validation auc = 0.652238
Epoch 857
Validation auc = 0.652510
Epoch 858
Loss = 7.8604e-04, PNorm = 109.6448, GNorm = 0.0219, lr_0 = 9.5754e-04
Validation auc = 0.652620
Epoch 859
Validation auc = 0.652729
Epoch 860
Validation auc = 0.652401
Epoch 861
Validation auc = 0.652456
Epoch 862
Validation auc = 0.652620
Epoch 863
Loss = 2.5872e-04, PNorm = 109.6578, GNorm = 0.0053, lr_0 = 9.5730e-04
Validation auc = 0.652783
Epoch 864
Validation auc = 0.653056
Epoch 865
Validation auc = 0.654528
Epoch 866
Validation auc = 0.654528
Epoch 867
Loss = 3.4401e-03, PNorm = 109.6599, GNorm = 0.2945, lr_0 = 9.5708e-04
Loss = 1.4892e-04, PNorm = 109.6600, GNorm = 0.0046, lr_0 = 9.5707e-04
Validation auc = 0.655345
Epoch 868
Validation auc = 0.656817
Epoch 869
Validation auc = 0.657253
Epoch 870
Validation auc = 0.657417
Epoch 871
Validation auc = 0.658235
Epoch 872
Loss = 1.7248e-03, PNorm = 109.6745, GNorm = 0.0354, lr_0 = 9.5683e-04
Loss = 3.5496e-04, PNorm = 109.6759, GNorm = 0.0192, lr_0 = 9.5681e-04
Validation auc = 0.658071
Epoch 873
Validation auc = 0.657799
Epoch 874
Validation auc = 0.657799
Epoch 875
Validation auc = 0.657417
Epoch 876
Validation auc = 0.657144
Epoch 877
Loss = 3.3063e-04, PNorm = 109.6899, GNorm = 0.0056, lr_0 = 9.5659e-04
Validation auc = 0.657308
Epoch 878
Validation auc = 0.656490
Epoch 879
Validation auc = 0.656490
Epoch 880
Validation auc = 0.656599
Epoch 881
Validation auc = 0.656872
Epoch 882
Loss = 3.9437e-04, PNorm = 109.6971, GNorm = 0.0113, lr_0 = 9.5634e-04
Validation auc = 0.657308
Epoch 883
Validation auc = 0.657253
Epoch 884
Validation auc = 0.659761
Epoch 885
Validation auc = 0.661942
Epoch 886
Loss = 3.2409e-04, PNorm = 109.7045, GNorm = 0.0046, lr_0 = 9.5612e-04
Loss = 6.4264e-04, PNorm = 109.7054, GNorm = 0.0165, lr_0 = 9.5610e-04
Validation auc = 0.664232
Epoch 887
Validation auc = 0.666249
Epoch 888
Validation auc = 0.666576
Epoch 889
Validation auc = 0.667066
Epoch 890
Validation auc = 0.666521
Epoch 891
Loss = 1.4275e-03, PNorm = 109.7158, GNorm = 0.0916, lr_0 = 9.5586e-04
Validation auc = 0.671700
Epoch 892
Validation auc = 0.665104
Epoch 893
Validation auc = 0.659761
Epoch 894
Validation auc = 0.653219
Epoch 895
Validation auc = 0.641117
Epoch 896
Loss = 3.8004e-02, PNorm = 109.8918, GNorm = 1.1219, lr_0 = 9.5563e-04
Validation auc = 0.604481
Epoch 897
Validation auc = 0.619419
Epoch 898
Validation auc = 0.663087
Epoch 899
Validation auc = 0.665376
Epoch 900
Loss = 4.8302e-03, PNorm = 110.1448, GNorm = 0.1120, lr_0 = 9.5541e-04
Loss = 4.1940e-03, PNorm = 110.1704, GNorm = 0.1118, lr_0 = 9.5539e-04
Validation auc = 0.663359
Epoch 901
Validation auc = 0.659652
Epoch 902
Validation auc = 0.656327
Epoch 903
Validation auc = 0.654637
Epoch 904
Validation auc = 0.654146
Epoch 905
Loss = 1.2335e-02, PNorm = 110.4234, GNorm = 1.5902, lr_0 = 9.5515e-04
Loss = 3.4666e-05, PNorm = 110.4347, GNorm = 0.0017, lr_0 = 9.5513e-04
Validation auc = 0.654855
Epoch 906
Validation auc = 0.660470
Epoch 907
Validation auc = 0.662651
Epoch 908
Validation auc = 0.657035
Epoch 909
Validation auc = 0.649567
Epoch 910
Loss = 3.1108e-03, PNorm = 110.5346, GNorm = 0.1307, lr_0 = 9.5491e-04
Validation auc = 0.652401
Epoch 911
Validation auc = 0.651693
Epoch 912
Validation auc = 0.671155
Epoch 913
Validation auc = 0.682767
Epoch 914
Validation auc = 0.696178
Epoch 915
Loss = 1.1937e-02, PNorm = 110.7881, GNorm = 0.3503, lr_0 = 9.5466e-04
Validation auc = 0.705610
Epoch 916
Validation auc = 0.710571
Epoch 917
Validation auc = 0.703756
Epoch 918
Validation auc = 0.700485
Epoch 919
Loss = 7.4799e-02, PNorm = 111.0677, GNorm = 0.4002, lr_0 = 9.5444e-04
Loss = 6.4397e-02, PNorm = 111.0967, GNorm = 2.0566, lr_0 = 9.5442e-04
Validation auc = 0.705446
Epoch 920
Validation auc = 0.686583
Epoch 921
Validation auc = 0.683476
Epoch 922
Validation auc = 0.672573
Epoch 923
Validation auc = 0.661288
Epoch 924
Loss = 2.9587e-02, PNorm = 111.6010, GNorm = 0.3364, lr_0 = 9.5419e-04
Validation auc = 0.654800
Epoch 925
Validation auc = 0.647549
Epoch 926
Validation auc = 0.644606
Epoch 927
Validation auc = 0.641880
Epoch 928
Validation auc = 0.638282
Epoch 929
Loss = 1.3761e-02, PNorm = 111.9520, GNorm = 0.3172, lr_0 = 9.5395e-04
Validation auc = 0.634465
Epoch 930
Validation auc = 0.636265
Epoch 931
Validation auc = 0.638827
Epoch 932
Validation auc = 0.641607
Epoch 933
Loss = 1.1083e-02, PNorm = 112.1280, GNorm = 0.0080, lr_0 = 9.5371e-04
Validation auc = 0.646078
Epoch 934
Validation auc = 0.652401
Epoch 935
Validation auc = 0.652510
Epoch 936
Validation auc = 0.653492
Epoch 937
Validation auc = 0.648967
Epoch 938
Loss = 6.5879e-03, PNorm = 112.2520, GNorm = 0.1058, lr_0 = 9.5348e-04
Loss = 5.5278e-03, PNorm = 112.2592, GNorm = 0.1692, lr_0 = 9.5346e-04
Validation auc = 0.646732
Epoch 939
Validation auc = 0.644006
Epoch 940
Validation auc = 0.642861
Epoch 941
Validation auc = 0.643079
Epoch 942
Validation auc = 0.642697
Epoch 943
Loss = 1.6180e-03, PNorm = 112.3227, GNorm = 0.0282, lr_0 = 9.5324e-04
Validation auc = 0.641062
Epoch 944
Validation auc = 0.642752
Epoch 945
Validation auc = 0.651638
Epoch 946
Validation auc = 0.644388
Epoch 947
Validation auc = 0.619146
Epoch 948
Loss = 2.5083e-02, PNorm = 112.8364, GNorm = 0.6549, lr_0 = 9.5299e-04
Validation auc = 0.598921
Epoch 949
Validation auc = 0.643624
Epoch 950
Validation auc = 0.636701
Epoch 951
Validation auc = 0.633103
Epoch 952
Loss = 5.9473e-02, PNorm = 113.4486, GNorm = 8.4548, lr_0 = 9.5277e-04
Loss = 1.6958e-03, PNorm = 113.4848, GNorm = 0.0788, lr_0 = 9.5275e-04
Validation auc = 0.623671
Epoch 953
Validation auc = 0.613586
Epoch 954
Validation auc = 0.613149
Epoch 955
Validation auc = 0.628796
Epoch 956
Validation auc = 0.658017
Epoch 957
Loss = 1.4079e-01, PNorm = 113.9431, GNorm = 1.6469, lr_0 = 9.5251e-04
Loss = 2.6529e-03, PNorm = 113.9808, GNorm = 0.0780, lr_0 = 9.5250e-04
Validation auc = 0.688928
Epoch 958
Validation auc = 0.695797
Epoch 959
Validation auc = 0.683749
Epoch 960
Validation auc = 0.672682
Epoch 961
Validation auc = 0.664068
Epoch 962
Loss = 1.0559e-01, PNorm = 114.4188, GNorm = 1.4285, lr_0 = 9.5228e-04
Validation auc = 0.658889
Epoch 963
Validation auc = 0.663141
Epoch 964
Validation auc = 0.665485
Epoch 965
Validation auc = 0.663414
Epoch 966
Loss = 6.0173e-02, PNorm = 114.8281, GNorm = 0.2706, lr_0 = 9.5204e-04
Validation auc = 0.658998
Epoch 967
Validation auc = 0.663087
Epoch 968
Validation auc = 0.674208
Epoch 969
Validation auc = 0.695143
Epoch 970
Validation auc = 0.708717
Epoch 971
Loss = 1.4566e-02, PNorm = 115.1706, GNorm = 0.6281, lr_0 = 9.5180e-04
Loss = 2.7072e-04, PNorm = 115.1958, GNorm = 0.0095, lr_0 = 9.5179e-04
Validation auc = 0.715368
Epoch 972
Validation auc = 0.715750
Epoch 973
Validation auc = 0.716186
Epoch 974
Validation auc = 0.722401
Epoch 975
Validation auc = 0.725672
Epoch 976
Loss = 1.0501e-02, PNorm = 115.4216, GNorm = 0.2893, lr_0 = 9.5157e-04
Validation auc = 0.725672
Epoch 977
Validation auc = 0.722673
Epoch 978
Validation auc = 0.716295
Epoch 979
Validation auc = 0.711825
Epoch 980
Validation auc = 0.706264
Epoch 981
Loss = 4.7085e-03, PNorm = 115.5675, GNorm = 0.1063, lr_0 = 9.5132e-04
Validation auc = 0.707899
Epoch 982
Validation auc = 0.708281
Epoch 983
Validation auc = 0.701466
Epoch 984
Validation auc = 0.697323
Epoch 985
Loss = 4.2463e-03, PNorm = 115.6421, GNorm = 0.2100, lr_0 = 9.5110e-04
Loss = 6.1461e-04, PNorm = 115.6479, GNorm = 0.0172, lr_0 = 9.5108e-04
Validation auc = 0.694379
Epoch 986
Validation auc = 0.691326
Epoch 987
Validation auc = 0.691108
Epoch 988
Validation auc = 0.691217
Epoch 989
Validation auc = 0.692580
Epoch 990
Loss = 5.7065e-03, PNorm = 115.6814, GNorm = 0.1495, lr_0 = 9.5084e-04
Loss = 8.8728e-03, PNorm = 115.6850, GNorm = 0.2290, lr_0 = 9.5083e-04
Validation auc = 0.694434
Epoch 991
Validation auc = 0.695742
Epoch 992
Validation auc = 0.703375
Epoch 993
Validation auc = 0.711988
Epoch 994
Validation auc = 0.720057
Epoch 995
Loss = 2.9960e-02, PNorm = 115.7557, GNorm = 0.8301, lr_0 = 9.5061e-04
Validation auc = 0.725835
Epoch 996
Validation auc = 0.728888
Epoch 997
Validation auc = 0.730524
Epoch 998
Validation auc = 0.732159
Epoch 999
Loss = 3.1436e-03, PNorm = 115.8582, GNorm = 0.0148, lr_0 = 9.5037e-04
Validation auc = 0.733195
Epoch 1000
Validation auc = 0.733086
Epoch 1001
Validation auc = 0.733577
Epoch 1002
Validation auc = 0.734286
Epoch 1003
Validation auc = 0.734831
Epoch 1004
Loss = 2.5811e-03, PNorm = 115.9130, GNorm = 0.0818, lr_0 = 9.5014e-04
Loss = 4.6484e-03, PNorm = 115.9163, GNorm = 0.0990, lr_0 = 9.5012e-04
Validation auc = 0.734340
Epoch 1005
Validation auc = 0.733904
Epoch 1006
Validation auc = 0.734885
Epoch 1007
Validation auc = 0.735212
Epoch 1008
Validation auc = 0.735049
Epoch 1009
Loss = 1.6432e-03, PNorm = 115.9485, GNorm = 0.0207, lr_0 = 9.4990e-04
Validation auc = 0.733086
Epoch 1010
Validation auc = 0.733086
Epoch 1011
Validation auc = 0.733195
Epoch 1012
Validation auc = 0.732814
Epoch 1013
Validation auc = 0.732268
Epoch 1014
Loss = 3.6315e-03, PNorm = 115.9887, GNorm = 0.0632, lr_0 = 9.4965e-04
Validation auc = 0.731396
Epoch 1015
Validation auc = 0.730960
Epoch 1016
Validation auc = 0.730742
Epoch 1017
Validation auc = 0.730469
Epoch 1018
Loss = 1.9917e-02, PNorm = 116.0068, GNorm = 0.5417, lr_0 = 9.4943e-04
Loss = 2.3652e-02, PNorm = 116.0106, GNorm = 1.0969, lr_0 = 9.4941e-04
Validation auc = 0.727689
Epoch 1019
Validation auc = 0.722946
Epoch 1020
Validation auc = 0.720656
Epoch 1021
Validation auc = 0.717603
Epoch 1022
Validation auc = 0.714769
Epoch 1023
Loss = 3.2488e-03, PNorm = 116.0621, GNorm = 0.0239, lr_0 = 9.4918e-04
Loss = 6.8768e-03, PNorm = 116.0654, GNorm = 0.1436, lr_0 = 9.4916e-04
Validation auc = 0.712588
Epoch 1024
Validation auc = 0.711116
Epoch 1025
Validation auc = 0.710244
Epoch 1026
Validation auc = 0.705337
Epoch 1027
Validation auc = 0.701957
Epoch 1028
Loss = 6.9134e-02, PNorm = 116.1027, GNorm = 0.9512, lr_0 = 9.4894e-04
Validation auc = 0.687946
Epoch 1029
Validation auc = 0.689582
Epoch 1030
Validation auc = 0.698632
Epoch 1031
Validation auc = 0.704574
Epoch 1032
Validation auc = 0.709480
Epoch 1033
Loss = 8.3173e-04, PNorm = 116.1374, GNorm = 0.0133, lr_0 = 9.4869e-04
Validation auc = 0.711280
Epoch 1034
Validation auc = 0.712479
Epoch 1035
Validation auc = 0.713515
Epoch 1036
Validation auc = 0.713842
Epoch 1037
Loss = 6.6220e-04, PNorm = 116.1564, GNorm = 0.0070, lr_0 = 9.4847e-04
Loss = 1.5285e-04, PNorm = 116.1574, GNorm = 0.0039, lr_0 = 9.4845e-04
Validation auc = 0.713406
Epoch 1038
Validation auc = 0.713951
Epoch 1039
Validation auc = 0.712915
Epoch 1040
Validation auc = 0.712697
Epoch 1041
Validation auc = 0.711225
Epoch 1042
Loss = 1.6922e-03, PNorm = 116.1621, GNorm = 0.0469, lr_0 = 9.4823e-04
Validation auc = 0.709317
Epoch 1043
Validation auc = 0.708608
Epoch 1044
Validation auc = 0.711170
Epoch 1045
Validation auc = 0.712915
Epoch 1046
Validation auc = 0.713242
Epoch 1047
Loss = 6.0853e-02, PNorm = 116.2007, GNorm = 0.8908, lr_0 = 9.4798e-04
Validation auc = 0.708717
Epoch 1048
Validation auc = 0.704247
Epoch 1049
Validation auc = 0.702775
Epoch 1050
Validation auc = 0.699831
Epoch 1051
Loss = 6.3988e-04, PNorm = 116.2374, GNorm = 0.0179, lr_0 = 9.4776e-04
Loss = 1.0265e-03, PNorm = 116.2393, GNorm = 0.0200, lr_0 = 9.4775e-04
Validation auc = 0.696833
Epoch 1052
Validation auc = 0.694052
Epoch 1053
Validation auc = 0.692689
Epoch 1054
Validation auc = 0.690836
Epoch 1055
Validation auc = 0.690073
Epoch 1056
Loss = 7.5442e-04, PNorm = 116.2552, GNorm = 0.0176, lr_0 = 9.4751e-04
Loss = 1.9315e-04, PNorm = 116.2559, GNorm = 0.0060, lr_0 = 9.4749e-04
Validation auc = 0.689854
Epoch 1057
Validation auc = 0.689582
Epoch 1058
Validation auc = 0.689418
Epoch 1059
Validation auc = 0.689582
Epoch 1060
Validation auc = 0.689527
Epoch 1061
Loss = 4.7737e-04, PNorm = 116.2620, GNorm = 0.0069, lr_0 = 9.4728e-04
Validation auc = 0.689745
Epoch 1062
Validation auc = 0.688982
Epoch 1063
Validation auc = 0.688382
Epoch 1064
Validation auc = 0.687674
Epoch 1065
Validation auc = 0.687565
Epoch 1066
Loss = 3.8309e-02, PNorm = 116.2742, GNorm = 1.2094, lr_0 = 9.4702e-04
Validation auc = 0.684512
Epoch 1067
Validation auc = 0.682549
Epoch 1068
Validation auc = 0.680369
Epoch 1069
Validation auc = 0.679060
Epoch 1070
Loss = 1.8026e-03, PNorm = 116.2887, GNorm = 0.0608, lr_0 = 9.4681e-04
Loss = 1.5934e-05, PNorm = 116.2900, GNorm = 0.0005, lr_0 = 9.4679e-04
Validation auc = 0.679115
Epoch 1071
Validation auc = 0.676825
Epoch 1072
Validation auc = 0.676443
Epoch 1073
Validation auc = 0.676988
Epoch 1074
Validation auc = 0.678406
Epoch 1075
Loss = 2.8892e-03, PNorm = 116.3189, GNorm = 0.0662, lr_0 = 9.4657e-04
Validation auc = 0.680259
Epoch 1076
Validation auc = 0.682059
Epoch 1077
Validation auc = 0.682331
Epoch 1078
Validation auc = 0.682549
Epoch 1079
Validation auc = 0.682658
Epoch 1080
Loss = 1.0538e-03, PNorm = 116.3348, GNorm = 0.0181, lr_0 = 9.4632e-04
Validation auc = 0.682931
Epoch 1081
Validation auc = 0.683203
Epoch 1082
Validation auc = 0.683312
Epoch 1083
Validation auc = 0.683040
Epoch 1084
Loss = 5.8164e-04, PNorm = 116.3423, GNorm = 0.0137, lr_0 = 9.4610e-04
Loss = 2.1556e-05, PNorm = 116.3427, GNorm = 0.0007, lr_0 = 9.4608e-04
Validation auc = 0.682822
Epoch 1085
Validation auc = 0.682440
Epoch 1086
Validation auc = 0.682440
Epoch 1087
Validation auc = 0.680587
Epoch 1088
Validation auc = 0.678733
Epoch 1089
Loss = 3.6822e-03, PNorm = 116.3520, GNorm = 0.1850, lr_0 = 9.4585e-04
Loss = 1.9212e-03, PNorm = 116.3530, GNorm = 0.0728, lr_0 = 9.4583e-04
Validation auc = 0.678460
Epoch 1090
Validation auc = 0.679060
Epoch 1091
Validation auc = 0.680096
Epoch 1092
Validation auc = 0.680859
Epoch 1093
Validation auc = 0.681950
Epoch 1094
Loss = 8.2729e-04, PNorm = 116.3636, GNorm = 0.0158, lr_0 = 9.4561e-04
Validation auc = 0.682277
Epoch 1095
Validation auc = 0.682658
Epoch 1096
Validation auc = 0.683312
Epoch 1097
Validation auc = 0.683585
Epoch 1098
Validation auc = 0.684294
Epoch 1099
Loss = 1.7402e-04, PNorm = 116.3728, GNorm = 0.0036, lr_0 = 9.4536e-04
Validation auc = 0.684948
Epoch 1100
Validation auc = 0.686256
Epoch 1101
Validation auc = 0.686747
Epoch 1102
Validation auc = 0.684566
Epoch 1103
Loss = 3.7484e-04, PNorm = 116.3875, GNorm = 0.0076, lr_0 = 9.4515e-04
Loss = 5.7500e-04, PNorm = 116.3896, GNorm = 0.0159, lr_0 = 9.4513e-04
Validation auc = 0.681840
Epoch 1104
Validation auc = 0.679169
Epoch 1105
Validation auc = 0.678733
Epoch 1106
Validation auc = 0.678406
Epoch 1107
Validation auc = 0.676879
Epoch 1108
Loss = 1.8508e-03, PNorm = 116.4098, GNorm = 0.0235, lr_0 = 9.4489e-04
Validation auc = 0.676988
Epoch 1109
Validation auc = 0.677425
Epoch 1110
Validation auc = 0.677915
Epoch 1111
Validation auc = 0.679006
Epoch 1112
Validation auc = 0.679660
Epoch 1113
Loss = 2.9550e-04, PNorm = 116.4210, GNorm = 0.0073, lr_0 = 9.4466e-04
Validation auc = 0.679769
Epoch 1114
Validation auc = 0.680150
Epoch 1115
Validation auc = 0.680259
Epoch 1116
Validation auc = 0.679551
Epoch 1117
Loss = 2.3796e-04, PNorm = 116.4299, GNorm = 0.0039, lr_0 = 9.4444e-04
Loss = 1.4939e-04, PNorm = 116.4304, GNorm = 0.0049, lr_0 = 9.4443e-04
Validation auc = 0.678842
Epoch 1118
Validation auc = 0.678297
Epoch 1119
Validation auc = 0.677915
Epoch 1120
Validation auc = 0.678515
Epoch 1121
Validation auc = 0.679660
Epoch 1122
Loss = 8.7929e-04, PNorm = 116.4418, GNorm = 0.0363, lr_0 = 9.4419e-04
Loss = 3.8477e-04, PNorm = 116.4428, GNorm = 0.0137, lr_0 = 9.4417e-04
Validation auc = 0.680805
Epoch 1123
Validation auc = 0.681513
Epoch 1124
Validation auc = 0.682386
Epoch 1125
Validation auc = 0.682767
Epoch 1126
Validation auc = 0.683312
Epoch 1127
Loss = 4.2801e-04, PNorm = 116.4532, GNorm = 0.0081, lr_0 = 9.4396e-04
Validation auc = 0.683585
Epoch 1128
Validation auc = 0.683858
Epoch 1129
Validation auc = 0.684185
Epoch 1130
Validation auc = 0.683912
Epoch 1131
Validation auc = 0.684239
Epoch 1132
Loss = 3.4267e-04, PNorm = 116.4604, GNorm = 0.0147, lr_0 = 9.4371e-04
Validation auc = 0.684457
Epoch 1133
Validation auc = 0.684403
Epoch 1134
Validation auc = 0.684457
Epoch 1135
Validation auc = 0.685221
Epoch 1136
Loss = 2.6515e-04, PNorm = 116.4647, GNorm = 0.0029, lr_0 = 9.4349e-04
Loss = 3.3317e-05, PNorm = 116.4651, GNorm = 0.0010, lr_0 = 9.4347e-04
Validation auc = 0.684566
Epoch 1137
Validation auc = 0.683912
Epoch 1138
Validation auc = 0.684239
Epoch 1139
Validation auc = 0.684294
Epoch 1140
Validation auc = 0.684403
Epoch 1141
Loss = 2.2422e-03, PNorm = 116.4688, GNorm = 0.0189, lr_0 = 9.4324e-04
Validation auc = 0.685929
Epoch 1142
Validation auc = 0.686311
Epoch 1143
Validation auc = 0.686638
Epoch 1144
Validation auc = 0.687183
Epoch 1145
Validation auc = 0.687456
Epoch 1146
Loss = 5.5187e-04, PNorm = 116.4735, GNorm = 0.0143, lr_0 = 9.4300e-04
Validation auc = 0.687456
Epoch 1147
Validation auc = 0.686911
Epoch 1148
Validation auc = 0.688055
Epoch 1149
Validation auc = 0.689091
Epoch 1150
Loss = 2.4963e-02, PNorm = 116.4802, GNorm = 0.0084, lr_0 = 9.4279e-04
Loss = 2.0972e-04, PNorm = 116.4815, GNorm = 0.0083, lr_0 = 9.4277e-04
Validation auc = 0.691763
Epoch 1151
Validation auc = 0.693780
Epoch 1152
Validation auc = 0.694652
Epoch 1153
Validation auc = 0.695252
Epoch 1154
Validation auc = 0.695524
Epoch 1155
Loss = 8.4000e-04, PNorm = 116.5102, GNorm = 0.0143, lr_0 = 9.4253e-04
Loss = 5.9887e-03, PNorm = 116.5123, GNorm = 0.1523, lr_0 = 9.4252e-04
Validation auc = 0.695633
Epoch 1156
Validation auc = 0.695197
Epoch 1157
Validation auc = 0.694761
Epoch 1158
Validation auc = 0.694052
Epoch 1159
Validation auc = 0.692853
Epoch 1160
Loss = 2.7194e-04, PNorm = 116.5324, GNorm = 0.0068, lr_0 = 9.4230e-04
Validation auc = 0.692199
Epoch 1161
Validation auc = 0.691763
Epoch 1162
Validation auc = 0.691599
Epoch 1163
Validation auc = 0.691217
Epoch 1164
Validation auc = 0.690672
Epoch 1165
Loss = 9.6521e-05, PNorm = 116.5423, GNorm = 0.0019, lr_0 = 9.4205e-04
Validation auc = 0.690127
Epoch 1166
Validation auc = 0.689582
Epoch 1167
Validation auc = 0.689418
Epoch 1168
Validation auc = 0.688655
Epoch 1169
Loss = 1.6775e-04, PNorm = 116.5465, GNorm = 0.0019, lr_0 = 9.4183e-04
Loss = 1.4505e-04, PNorm = 116.5467, GNorm = 0.0055, lr_0 = 9.4182e-04
Validation auc = 0.688164
Epoch 1170
Validation auc = 0.687674
Epoch 1171
Validation auc = 0.687238
Epoch 1172
Validation auc = 0.687074
Epoch 1173
Validation auc = 0.686965
Epoch 1174
Loss = 7.6906e-05, PNorm = 116.5496, GNorm = 0.0019, lr_0 = 9.4158e-04
Validation auc = 0.686856
Epoch 1175
Validation auc = 0.686802
Epoch 1176
Validation auc = 0.686583
Epoch 1177
Validation auc = 0.686529
Epoch 1178
Validation auc = 0.686038
Epoch 1179
Loss = 2.4940e-02, PNorm = 116.5525, GNorm = 0.5693, lr_0 = 9.4135e-04
Validation auc = 0.684730
Epoch 1180
Validation auc = 0.683258
Epoch 1181
Validation auc = 0.682168
Epoch 1182
Validation auc = 0.681622
Epoch 1183
Loss = 7.3339e-04, PNorm = 116.5649, GNorm = 0.0155, lr_0 = 9.4112e-04
Validation auc = 0.680805
Epoch 1184
Validation auc = 0.680696
Epoch 1185
Validation auc = 0.680750
Epoch 1186
Validation auc = 0.681295
Epoch 1187
Validation auc = 0.681568
Epoch 1188
Loss = 2.7623e-04, PNorm = 116.5794, GNorm = 0.0077, lr_0 = 9.4088e-04
Loss = 3.5979e-05, PNorm = 116.5801, GNorm = 0.0018, lr_0 = 9.4087e-04
Validation auc = 0.681895
Epoch 1189
Validation auc = 0.681786
Epoch 1190
Validation auc = 0.681786
Epoch 1191
Validation auc = 0.681731
Epoch 1192
Validation auc = 0.681786
Epoch 1193
Loss = 1.7363e-04, PNorm = 116.5871, GNorm = 0.0035, lr_0 = 9.4065e-04
Validation auc = 0.681786
Epoch 1194
Validation auc = 0.681840
Epoch 1195
Validation auc = 0.681895
Epoch 1196
Validation auc = 0.679224
Epoch 1197
Validation auc = 0.673936
Epoch 1198
Loss = 8.8019e-05, PNorm = 116.5932, GNorm = 0.0022, lr_0 = 9.4040e-04
Validation auc = 0.671101
Epoch 1199
Validation auc = 0.667884
Epoch 1200
Validation auc = 0.666140
Epoch 1201
Validation auc = 0.667448
Epoch 1202
Loss = 5.5277e-04, PNorm = 116.6013, GNorm = 0.0032, lr_0 = 9.4018e-04
Loss = 3.7012e-05, PNorm = 116.6019, GNorm = 0.0014, lr_0 = 9.4016e-04
Validation auc = 0.669029
Epoch 1203
Validation auc = 0.667775
Epoch 1204
Validation auc = 0.662651
Epoch 1205
Validation auc = 0.655781
Epoch 1206
Validation auc = 0.653928
Epoch 1207
Loss = 1.0385e-03, PNorm = 116.6297, GNorm = 0.0289, lr_0 = 9.3993e-04
Loss = 1.9069e-04, PNorm = 116.6323, GNorm = 0.0091, lr_0 = 9.3991e-04
Validation auc = 0.653001
Epoch 1208
Validation auc = 0.653437
Epoch 1209
Validation auc = 0.652892
Epoch 1210
Validation auc = 0.653873
Epoch 1211
Validation auc = 0.654091
Epoch 1212
Loss = 1.0428e-04, PNorm = 116.6594, GNorm = 0.0021, lr_0 = 9.3970e-04
Validation auc = 0.656381
Epoch 1213
Validation auc = 0.657744
Epoch 1214
Validation auc = 0.658834
Epoch 1215
Validation auc = 0.660088
Epoch 1216
Loss = 5.1202e-05, PNorm = 116.6715, GNorm = 0.0012, lr_0 = 9.3946e-04
Validation auc = 0.660579
Epoch 1217
Validation auc = 0.661015
Epoch 1218
Validation auc = 0.661451
Epoch 1219
Validation auc = 0.662378
Epoch 1220
Validation auc = 0.665867
Epoch 1221
Loss = 5.1912e-04, PNorm = 116.6768, GNorm = 0.0243, lr_0 = 9.3923e-04
Loss = 6.1810e-04, PNorm = 116.6781, GNorm = 0.0287, lr_0 = 9.3922e-04
Validation auc = 0.671537
Epoch 1222
Validation auc = 0.691163
Epoch 1223
Validation auc = 0.687456
Epoch 1224
Validation auc = 0.678297
Epoch 1225
Validation auc = 0.675953
Epoch 1226
Loss = 3.9556e-04, PNorm = 116.6935, GNorm = 0.0151, lr_0 = 9.3900e-04
Validation auc = 0.678733
Epoch 1227
Validation auc = 0.682549
Epoch 1228
Validation auc = 0.686147
Epoch 1229
Validation auc = 0.688328
Epoch 1230
Validation auc = 0.689364
Epoch 1231
Loss = 1.2802e-03, PNorm = 116.7132, GNorm = 0.1087, lr_0 = 9.3875e-04
Validation auc = 0.688546
Epoch 1232
Validation auc = 0.682440
Epoch 1233
Validation auc = 0.675517
Epoch 1234
Validation auc = 0.671700
Epoch 1235
Loss = 4.5459e-05, PNorm = 116.7320, GNorm = 0.0016, lr_0 = 9.3853e-04
Loss = 2.3444e-06, PNorm = 116.7347, GNorm = 0.0001, lr_0 = 9.3852e-04
Validation auc = 0.668702
Epoch 1236
Validation auc = 0.662324
Epoch 1237
Validation auc = 0.655672
Epoch 1238
Validation auc = 0.652838
Epoch 1239
Validation auc = 0.650548
Epoch 1240
Loss = 2.5042e-04, PNorm = 116.7597, GNorm = 0.0059, lr_0 = 9.3828e-04
Loss = 2.3028e-04, PNorm = 116.7610, GNorm = 0.0100, lr_0 = 9.3827e-04
Validation auc = 0.648803
Epoch 1241
Validation auc = 0.647986
Epoch 1242
Validation auc = 0.647713
Epoch 1243
Validation auc = 0.652129
Epoch 1244
Validation auc = 0.655236
Epoch 1245
Loss = 1.4400e-03, PNorm = 116.7982, GNorm = 0.0530, lr_0 = 9.3805e-04
Validation auc = 0.656272
Epoch 1246
Validation auc = 0.659434
Epoch 1247
Validation auc = 0.661669
Epoch 1248
Validation auc = 0.663632
Epoch 1249
Loss = 4.6875e-04, PNorm = 116.8816, GNorm = 0.0401, lr_0 = 9.3782e-04
Validation auc = 0.666085
Epoch 1250
Validation auc = 0.668102
Epoch 1251
Validation auc = 0.668975
Epoch 1252
Validation auc = 0.669792
Epoch 1253
Validation auc = 0.670010
Epoch 1254
Loss = 1.8971e-04, PNorm = 116.9168, GNorm = 0.0018, lr_0 = 9.3758e-04
Loss = 3.0953e-05, PNorm = 116.9181, GNorm = 0.0014, lr_0 = 9.3757e-04
Validation auc = 0.669901
Epoch 1255
Validation auc = 0.668102
Epoch 1256
Validation auc = 0.666467
Epoch 1257
Validation auc = 0.665976
Epoch 1258
Validation auc = 0.664995
Epoch 1259
Loss = 1.2075e-04, PNorm = 116.9287, GNorm = 0.0051, lr_0 = 9.3735e-04
Validation auc = 0.664286
Epoch 1260
Validation auc = 0.663850
Epoch 1261
Validation auc = 0.663850
Epoch 1262
Validation auc = 0.663686
Epoch 1263
Validation auc = 0.663741
Epoch 1264
Loss = 1.6183e-04, PNorm = 116.9353, GNorm = 0.0034, lr_0 = 9.3710e-04
Validation auc = 0.663741
Epoch 1265
Validation auc = 0.654909
Epoch 1266
Validation auc = 0.644660
Epoch 1267
Validation auc = 0.667612
Epoch 1268
Loss = 3.1869e-04, PNorm = 116.9451, GNorm = 0.0251, lr_0 = 9.3689e-04
Loss = 1.6590e-05, PNorm = 116.9464, GNorm = 0.0010, lr_0 = 9.3687e-04
Validation auc = 0.676389
Epoch 1269
Validation auc = 0.679878
Epoch 1270
Validation auc = 0.681622
Epoch 1271
Validation auc = 0.682604
Epoch 1272
Validation auc = 0.682495
Epoch 1273
Loss = 1.3458e-04, PNorm = 116.9637, GNorm = 0.0065, lr_0 = 9.3664e-04
Loss = 3.6734e-05, PNorm = 116.9646, GNorm = 0.0019, lr_0 = 9.3662e-04
Validation auc = 0.682168
Epoch 1274
Validation auc = 0.681404
Epoch 1275
Validation auc = 0.681077
Epoch 1276
Validation auc = 0.680478
Epoch 1277
Validation auc = 0.680532
Epoch 1278
Loss = 1.8298e-04, PNorm = 116.9811, GNorm = 0.0037, lr_0 = 9.3641e-04
Validation auc = 0.680423
Epoch 1279
Validation auc = 0.679442
Epoch 1280
Validation auc = 0.678406
Epoch 1281
Validation auc = 0.677316
Epoch 1282
Validation auc = 0.677207
Epoch 1283
Loss = 8.7649e-04, PNorm = 116.9930, GNorm = 0.0233, lr_0 = 9.3616e-04
Validation auc = 0.676879
Epoch 1284
Validation auc = 0.676879
Epoch 1285
Validation auc = 0.676825
Epoch 1286
Validation auc = 0.676825
Epoch 1287
Loss = 1.5277e-04, PNorm = 117.0011, GNorm = 0.0026, lr_0 = 9.3594e-04
Loss = 3.1270e-04, PNorm = 117.0016, GNorm = 0.0255, lr_0 = 9.3592e-04
Validation auc = 0.677643
Epoch 1288
Validation auc = 0.677806
Epoch 1289
Validation auc = 0.677479
Epoch 1290
Validation auc = 0.677207
Epoch 1291
Validation auc = 0.677152
Epoch 1292
Loss = 9.3165e-05, PNorm = 117.0068, GNorm = 0.0019, lr_0 = 9.3571e-04
Validation auc = 0.676988
Epoch 1293
Validation auc = 0.676716
Epoch 1294
Validation auc = 0.676770
Epoch 1295
Validation auc = 0.676825
Epoch 1296
Validation auc = 0.676879
Epoch 1297
Loss = 7.9824e-05, PNorm = 117.0103, GNorm = 0.0023, lr_0 = 9.3546e-04
Validation auc = 0.676934
Epoch 1298
Validation auc = 0.676934
Epoch 1299
Validation auc = 0.677098
Epoch 1300
Validation auc = 0.677043
Epoch 1301
Loss = 4.0898e-02, PNorm = 117.0136, GNorm = 0.0021, lr_0 = 9.3524e-04
Loss = 1.1850e-04, PNorm = 117.0146, GNorm = 0.0039, lr_0 = 9.3523e-04
Validation auc = 0.675844
Epoch 1302
Validation auc = 0.673227
Epoch 1303
Validation auc = 0.669901
Epoch 1304
Validation auc = 0.666576
Epoch 1305
Validation auc = 0.662760
Epoch 1306
Loss = 4.8380e-04, PNorm = 117.0337, GNorm = 0.0059, lr_0 = 9.3499e-04
Loss = 1.2413e-04, PNorm = 117.0347, GNorm = 0.0040, lr_0 = 9.3498e-04
Validation auc = 0.660252
Epoch 1307
Validation auc = 0.657908
Epoch 1308
Validation auc = 0.656545
Epoch 1309
Validation auc = 0.654746
Epoch 1310
Validation auc = 0.653328
Epoch 1311
Loss = 1.3642e-04, PNorm = 117.0452, GNorm = 0.0048, lr_0 = 9.3476e-04
Validation auc = 0.652347
Epoch 1312
Validation auc = 0.651693
Epoch 1313
Validation auc = 0.651475
Epoch 1314
Validation auc = 0.651529
Epoch 1315
Validation auc = 0.650548
Epoch 1316
Loss = 8.5213e-05, PNorm = 117.0527, GNorm = 0.0028, lr_0 = 9.3451e-04
Validation auc = 0.650602
Epoch 1317
Validation auc = 0.649185
Epoch 1318
Validation auc = 0.648531
Epoch 1319
Validation auc = 0.648749
Epoch 1320
Loss = 2.0214e-03, PNorm = 117.0635, GNorm = 0.0006, lr_0 = 9.3430e-04
Loss = 3.8782e-04, PNorm = 117.0639, GNorm = 0.0448, lr_0 = 9.3428e-04
Validation auc = 0.651747
Epoch 1321
Validation auc = 0.654909
Epoch 1322
Validation auc = 0.657253
Epoch 1323
Validation auc = 0.658834
Epoch 1324
Validation auc = 0.659761
Epoch 1325
Loss = 3.0744e-05, PNorm = 117.0694, GNorm = 0.0009, lr_0 = 9.3407e-04
Validation auc = 0.660361
Epoch 1326
Validation auc = 0.661124
Epoch 1327
Validation auc = 0.661233
Epoch 1328
Validation auc = 0.661397
Epoch 1329
Validation auc = 0.661342
Epoch 1330
Loss = 5.7820e-05, PNorm = 117.0735, GNorm = 0.0012, lr_0 = 9.3382e-04
Validation auc = 0.661451
Epoch 1331
Validation auc = 0.661669
Epoch 1332
Validation auc = 0.661724
Epoch 1333
Validation auc = 0.661778
Epoch 1334
Loss = 5.0328e-05, PNorm = 117.0752, GNorm = 0.0019, lr_0 = 9.3360e-04
Loss = 3.8342e-05, PNorm = 117.0753, GNorm = 0.0021, lr_0 = 9.3359e-04
Validation auc = 0.661996
Epoch 1335
Validation auc = 0.661996
Epoch 1336
Validation auc = 0.662051
Epoch 1337
Validation auc = 0.662105
Epoch 1338
Validation auc = 0.662105
Epoch 1339
Loss = 4.6480e-05, PNorm = 117.0768, GNorm = 0.0014, lr_0 = 9.3336e-04
Loss = 3.0953e-05, PNorm = 117.0769, GNorm = 0.0018, lr_0 = 9.3334e-04
Validation auc = 0.662105
Epoch 1340
Validation auc = 0.662105
Epoch 1341
Validation auc = 0.662105
Epoch 1342
Validation auc = 0.662051
Epoch 1343
Validation auc = 0.662160
Epoch 1344
Loss = 3.8275e-05, PNorm = 117.0781, GNorm = 0.0009, lr_0 = 9.3312e-04
Validation auc = 0.662160
Epoch 1345
Validation auc = 0.662105
Epoch 1346
Validation auc = 0.662160
Epoch 1347
Validation auc = 0.662214
Epoch 1348
Validation auc = 0.662214
Epoch 1349
Loss = 3.1421e-05, PNorm = 117.0795, GNorm = 0.0008, lr_0 = 9.3288e-04
Validation auc = 0.662214
Epoch 1350
Validation auc = 0.662051
Epoch 1351
Validation auc = 0.662160
Epoch 1352
Validation auc = 0.662105
Epoch 1353
Loss = 2.7362e-05, PNorm = 117.0815, GNorm = 0.0006, lr_0 = 9.3266e-04
Loss = 5.4041e-06, PNorm = 117.0816, GNorm = 0.0003, lr_0 = 9.3264e-04
Validation auc = 0.662051
Epoch 1354
Validation auc = 0.662160
Epoch 1355
Validation auc = 0.665104
Epoch 1356
Validation auc = 0.665758
Epoch 1357
Validation auc = 0.666140
Epoch 1358
Loss = 7.3078e-03, PNorm = 117.0891, GNorm = 0.7581, lr_0 = 9.3241e-04
Validation auc = 0.667230
Epoch 1359
Validation auc = 0.667285
Epoch 1360
Validation auc = 0.667339
Epoch 1361
Validation auc = 0.667884
Epoch 1362
Validation auc = 0.666957
Epoch 1363
Loss = 4.2821e-05, PNorm = 117.1086, GNorm = 0.0009, lr_0 = 9.3218e-04
Validation auc = 0.666903
Epoch 1364
Validation auc = 0.666739
Epoch 1365
Validation auc = 0.666848
Epoch 1366
Validation auc = 0.667394
Epoch 1367
Loss = 8.7304e-05, PNorm = 117.1166, GNorm = 0.0073, lr_0 = 9.3197e-04
Loss = 8.5902e-05, PNorm = 117.1171, GNorm = 0.0034, lr_0 = 9.3195e-04
Validation auc = 0.667612
Epoch 1368
Validation auc = 0.667612
Epoch 1369
Validation auc = 0.667612
Epoch 1370
Validation auc = 0.667612
Epoch 1371
Validation auc = 0.667612
Epoch 1372
Loss = 8.0229e-05, PNorm = 117.1238, GNorm = 0.0063, lr_0 = 9.3172e-04
Loss = 9.1723e-03, PNorm = 117.1247, GNorm = 0.4668, lr_0 = 9.3170e-04
Validation auc = 0.667285
Epoch 1373
Validation auc = 0.665704
Epoch 1374
Validation auc = 0.665322
Epoch 1375
Validation auc = 0.665049
Epoch 1376
Validation auc = 0.664722
Epoch 1377
Loss = 2.8177e-04, PNorm = 117.1358, GNorm = 0.0099, lr_0 = 9.3149e-04
Validation auc = 0.665104
Epoch 1378
Validation auc = 0.665431
Epoch 1379
Validation auc = 0.665485
Epoch 1380
Validation auc = 0.665649
Epoch 1381
Validation auc = 0.666249
Epoch 1382
Loss = 3.1421e-04, PNorm = 117.1466, GNorm = 0.0139, lr_0 = 9.3124e-04
Validation auc = 0.666794
Epoch 1383
Validation auc = 0.666521
Epoch 1384
Validation auc = 0.666358
Epoch 1385
Validation auc = 0.666903
Epoch 1386
Loss = 8.1657e-05, PNorm = 117.1517, GNorm = 0.0021, lr_0 = 9.3102e-04
Loss = 1.1463e-04, PNorm = 117.1519, GNorm = 0.0046, lr_0 = 9.3101e-04
Validation auc = 0.667175
Epoch 1387
Validation auc = 0.667066
Epoch 1388
Validation auc = 0.667394
Epoch 1389
Validation auc = 0.667612
Epoch 1390
Validation auc = 0.667939
Epoch 1391
Loss = 7.2694e-05, PNorm = 117.1554, GNorm = 0.0039, lr_0 = 9.3078e-04
Validation auc = 0.667884
Epoch 1392
Validation auc = 0.668048
Epoch 1393
Validation auc = 0.668157
Epoch 1394
Validation auc = 0.668048
Epoch 1395
Validation auc = 0.668157
Epoch 1396
Loss = 4.0373e-05, PNorm = 117.1579, GNorm = 0.0011, lr_0 = 9.3055e-04
Validation auc = 0.668048
Epoch 1397
Validation auc = 0.667993
Epoch 1398
Validation auc = 0.667993
Epoch 1399
Validation auc = 0.667884
Epoch 1400
Loss = 1.0565e-04, PNorm = 117.1600, GNorm = 0.0009, lr_0 = 9.3033e-04
Loss = 3.4985e-05, PNorm = 117.1602, GNorm = 0.0013, lr_0 = 9.3032e-04
Validation auc = 0.667612
Epoch 1401
Validation auc = 0.667612
Epoch 1402
Validation auc = 0.667612
Epoch 1403
Validation auc = 0.667394
Epoch 1404
Validation auc = 0.667394
Epoch 1405
Loss = 1.3031e-04, PNorm = 117.1621, GNorm = 0.0006, lr_0 = 9.3008e-04
Loss = 2.3444e-06, PNorm = 117.1622, GNorm = 0.0001, lr_0 = 9.3007e-04
Validation auc = 0.667339
Epoch 1406
Validation auc = 0.667394
Epoch 1407
Validation auc = 0.667339
Epoch 1408
Validation auc = 0.667503
Epoch 1409
Validation auc = 0.667339
Epoch 1410
Loss = 2.0552e-05, PNorm = 117.1641, GNorm = 0.0005, lr_0 = 9.2985e-04
Validation auc = 0.667775
Epoch 1411
Validation auc = 0.667939
Epoch 1412
Validation auc = 0.667939
Epoch 1413
Validation auc = 0.667939
Epoch 1414
Validation auc = 0.667939
Epoch 1415
Loss = 5.2336e-05, PNorm = 117.1664, GNorm = 0.0026, lr_0 = 9.2961e-04
Validation auc = 0.667939
Epoch 1416
Validation auc = 0.667993
Epoch 1417
Validation auc = 0.668102
Epoch 1418
Validation auc = 0.667830
Epoch 1419
Loss = 5.3589e-05, PNorm = 117.1679, GNorm = 0.0012, lr_0 = 9.2939e-04
Loss = 3.2264e-05, PNorm = 117.1680, GNorm = 0.0014, lr_0 = 9.2938e-04
Validation auc = 0.667993
Epoch 1420
Validation auc = 0.668157
Epoch 1421
Validation auc = 0.668157
Epoch 1422
Validation auc = 0.668102
Epoch 1423
Validation auc = 0.667993
Epoch 1424
Loss = 2.0140e-04, PNorm = 117.1695, GNorm = 0.0249, lr_0 = 9.2914e-04
Validation auc = 0.667830
Epoch 1425
Validation auc = 0.667775
Epoch 1426
Validation auc = 0.667830
Epoch 1427
Validation auc = 0.667721
Epoch 1428
Validation auc = 0.667775
Epoch 1429
Loss = 2.0642e-05, PNorm = 117.1712, GNorm = 0.0006, lr_0 = 9.2891e-04
Validation auc = 0.667830
Epoch 1430
Validation auc = 0.667939
Epoch 1431
Validation auc = 0.667830
Epoch 1432
Validation auc = 0.667993
Epoch 1433
Loss = 3.2662e-05, PNorm = 117.1728, GNorm = 0.0008, lr_0 = 9.2868e-04
Validation auc = 0.668048
Epoch 1434
Validation auc = 0.668048
Epoch 1435
Validation auc = 0.667884
Epoch 1436
Validation auc = 0.667993
Epoch 1437
Validation auc = 0.667993
Epoch 1438
Loss = 2.0217e-05, PNorm = 117.1742, GNorm = 0.0005, lr_0 = 9.2845e-04
Loss = 2.9802e-07, PNorm = 117.1743, GNorm = 0.0000, lr_0 = 9.2844e-04
Validation auc = 0.668048
Epoch 1439
Validation auc = 0.668102
Epoch 1440
Validation auc = 0.668048
Epoch 1441
Validation auc = 0.667339
Epoch 1442
Validation auc = 0.666739
Epoch 1443
Loss = 2.2068e-05, PNorm = 117.1765, GNorm = 0.0005, lr_0 = 9.2822e-04
Validation auc = 0.666031
Epoch 1444
Validation auc = 0.665376
Epoch 1445
Validation auc = 0.664886
Epoch 1446
Validation auc = 0.664722
Epoch 1447
Validation auc = 0.664668
Epoch 1448
Loss = 6.3445e-05, PNorm = 117.1800, GNorm = 0.0019, lr_0 = 9.2798e-04
Validation auc = 0.664613
Epoch 1449
Validation auc = 0.664504
Epoch 1450
Validation auc = 0.664504
Epoch 1451
Validation auc = 0.664613
Epoch 1452
Loss = 3.6911e-05, PNorm = 117.1821, GNorm = 0.0011, lr_0 = 9.2776e-04
Loss = 8.0863e-06, PNorm = 117.1822, GNorm = 0.0004, lr_0 = 9.2775e-04
Validation auc = 0.664559
Epoch 1453
Validation auc = 0.664504
Epoch 1454
Validation auc = 0.664668
Epoch 1455
Validation auc = 0.664831
Epoch 1456
Validation auc = 0.664722
Epoch 1457
Loss = 2.4158e-05, PNorm = 117.1838, GNorm = 0.0005, lr_0 = 9.2752e-04
Loss = 4.0332e-06, PNorm = 117.1839, GNorm = 0.0004, lr_0 = 9.2750e-04
Validation auc = 0.664722
Epoch 1458
Validation auc = 0.664668
Epoch 1459
Validation auc = 0.664886
Epoch 1460
Validation auc = 0.664995
Epoch 1461
Validation auc = 0.665049
Epoch 1462
Loss = 4.3894e-05, PNorm = 117.1854, GNorm = 0.0011, lr_0 = 9.2729e-04
Validation auc = 0.664940
Epoch 1463
Validation auc = 0.665104
Epoch 1464
Validation auc = 0.665104
Epoch 1465
Validation auc = 0.665049
Epoch 1466
Loss = 1.9979e-05, PNorm = 117.1868, GNorm = 0.0009, lr_0 = 9.2706e-04
Validation auc = 0.665431
Epoch 1467
Validation auc = 0.665540
Epoch 1468
Validation auc = 0.665813
Epoch 1469
Validation auc = 0.665976
Epoch 1470
Validation auc = 0.666085
Epoch 1471
Loss = 2.6628e-05, PNorm = 117.1883, GNorm = 0.0007, lr_0 = 9.2683e-04
Loss = 1.0788e-05, PNorm = 117.1884, GNorm = 0.0005, lr_0 = 9.2681e-04
Validation auc = 0.665976
Epoch 1472
Validation auc = 0.666085
Epoch 1473
Validation auc = 0.666085
Epoch 1474
Validation auc = 0.665976
Epoch 1475
Validation auc = 0.665922
Epoch 1476
Loss = 8.0798e-04, PNorm = 117.1902, GNorm = 0.0768, lr_0 = 9.2660e-04
Validation auc = 0.668048
Epoch 1477
Validation auc = 0.670228
Epoch 1478
Validation auc = 0.673281
Epoch 1479
Validation auc = 0.675571
Epoch 1480
Validation auc = 0.677152
Epoch 1481
Loss = 4.7413e-04, PNorm = 117.1985, GNorm = 0.0287, lr_0 = 9.2635e-04
Validation auc = 0.677534
Epoch 1482
Validation auc = 0.678024
Epoch 1483
Validation auc = 0.677697
Epoch 1484
Validation auc = 0.677970
Epoch 1485
Loss = 1.1191e-04, PNorm = 117.2053, GNorm = 0.0018, lr_0 = 9.2614e-04
Loss = 2.4535e-05, PNorm = 117.2058, GNorm = 0.0012, lr_0 = 9.2612e-04
Validation auc = 0.678242
Epoch 1486
Validation auc = 0.677752
Epoch 1487
Validation auc = 0.677861
Epoch 1488
Validation auc = 0.677806
Epoch 1489
Validation auc = 0.677915
Epoch 1490
Loss = 2.0127e-05, PNorm = 117.2113, GNorm = 0.0006, lr_0 = 9.2589e-04
Loss = 4.1326e-06, PNorm = 117.2116, GNorm = 0.0002, lr_0 = 9.2587e-04
Validation auc = 0.677970
Epoch 1491
Validation auc = 0.678460
Epoch 1492
Validation auc = 0.679169
Epoch 1493
Validation auc = 0.679224
Epoch 1494
Validation auc = 0.679006
Epoch 1495
Loss = 3.3591e-05, PNorm = 117.2139, GNorm = 0.0014, lr_0 = 9.2566e-04
Validation auc = 0.678897
Epoch 1496
Validation auc = 0.677588
Epoch 1497
Validation auc = 0.676661
Epoch 1498
Validation auc = 0.675571
Epoch 1499
Loss = 1.4229e-05, PNorm = 117.2149, GNorm = 0.0002, lr_0 = 9.2543e-04
Validation auc = 0.675408
Epoch 1500
Validation auc = 0.674535
Epoch 1501
Validation auc = 0.673936
Epoch 1502
Validation auc = 0.673717
Epoch 1503
Validation auc = 0.673336
Epoch 1504
Loss = 3.2303e-05, PNorm = 117.2159, GNorm = 0.0039, lr_0 = 9.2520e-04
Loss = 5.9605e-08, PNorm = 117.2159, GNorm = 0.0000, lr_0 = 9.2518e-04
Validation auc = 0.672954
Epoch 1505
Validation auc = 0.672682
Epoch 1506
Validation auc = 0.671482
Epoch 1507
Validation auc = 0.670446
Epoch 1508
Validation auc = 0.670392
Epoch 1509
Loss = 2.1084e-05, PNorm = 117.2163, GNorm = 0.0006, lr_0 = 9.2497e-04
Validation auc = 0.670337
Epoch 1510
Validation auc = 0.669683
Epoch 1511
Validation auc = 0.669574
Epoch 1512
Validation auc = 0.669901
Epoch 1513
Validation auc = 0.669520
Epoch 1514
Loss = 8.4396e-06, PNorm = 117.2187, GNorm = 0.0003, lr_0 = 9.2472e-04
Validation auc = 0.669792
Epoch 1515
Validation auc = 0.669574
Epoch 1516
Validation auc = 0.669792
Epoch 1517
Validation auc = 0.669029
Epoch 1518
Loss = 1.7076e-05, PNorm = 117.2206, GNorm = 0.0004, lr_0 = 9.2451e-04
Loss = 2.0503e-05, PNorm = 117.2207, GNorm = 0.0008, lr_0 = 9.2449e-04
Validation auc = 0.667612
Epoch 1519
Validation auc = 0.667012
Epoch 1520
Validation auc = 0.666467
Epoch 1521
Validation auc = 0.666140
Epoch 1522
Validation auc = 0.664886
Epoch 1523
Loss = 7.5407e-06, PNorm = 117.2224, GNorm = 0.0001, lr_0 = 9.2427e-04
Loss = 1.2457e-05, PNorm = 117.2225, GNorm = 0.0008, lr_0 = 9.2425e-04
Validation auc = 0.664232
Epoch 1524
Validation auc = 0.663523
Epoch 1525
Validation auc = 0.662433
Epoch 1526
Validation auc = 0.661179
Epoch 1527
Validation auc = 0.659052
Epoch 1528
Loss = 1.2629e-05, PNorm = 117.2242, GNorm = 0.0003, lr_0 = 9.2404e-04
Validation auc = 0.658344
Epoch 1529
Validation auc = 0.657853
Epoch 1530
Validation auc = 0.658616
Epoch 1531
Validation auc = 0.658889
Epoch 1532
Validation auc = 0.659107
Epoch 1533
Loss = 1.2037e-05, PNorm = 117.2263, GNorm = 0.0003, lr_0 = 9.2379e-04
Validation auc = 0.659380
Epoch 1534
Validation auc = 0.659325
Epoch 1535
Validation auc = 0.658998
Epoch 1536
Validation auc = 0.659216
Epoch 1537
Loss = 2.6014e-05, PNorm = 117.2274, GNorm = 0.0018, lr_0 = 9.2358e-04
Loss = 7.5499e-07, PNorm = 117.2275, GNorm = 0.0001, lr_0 = 9.2356e-04
Validation auc = 0.659216
Epoch 1538
Validation auc = 0.659598
Epoch 1539
Validation auc = 0.659707
Epoch 1540
Validation auc = 0.659489
Epoch 1541
Validation auc = 0.659380
Epoch 1542
Loss = 1.5377e-05, PNorm = 117.2284, GNorm = 0.0009, lr_0 = 9.2335e-04
Validation auc = 0.658180
Epoch 1543
Validation auc = 0.656490
Epoch 1544
Validation auc = 0.655400
Epoch 1545
Validation auc = 0.654528
Epoch 1546
Validation auc = 0.653764
Epoch 1547
Loss = 3.6120e-06, PNorm = 117.2289, GNorm = 0.0001, lr_0 = 9.2310e-04
Validation auc = 0.653601
Epoch 1548
Validation auc = 0.653383
Epoch 1549
Validation auc = 0.653655
Epoch 1550
Validation auc = 0.653873
Epoch 1551
Loss = 1.0213e-05, PNorm = 117.2296, GNorm = 0.0001, lr_0 = 9.2289e-04
Loss = 7.9473e-08, PNorm = 117.2297, GNorm = 0.0000, lr_0 = 9.2287e-04
Validation auc = 0.654746
Epoch 1552
Validation auc = 0.655182
Epoch 1553
Validation auc = 0.655836
Epoch 1554
Validation auc = 0.655781
Epoch 1555
Validation auc = 0.655781
Epoch 1556
Loss = 2.2769e-06, PNorm = 117.2306, GNorm = 0.0001, lr_0 = 9.2264e-04
Loss = 2.6822e-06, PNorm = 117.2307, GNorm = 0.0002, lr_0 = 9.2263e-04
Validation auc = 0.656218
Epoch 1557
Validation auc = 0.656381
Epoch 1558
Validation auc = 0.656872
Epoch 1559
Validation auc = 0.656708
Epoch 1560
Validation auc = 0.653274
Epoch 1561
Loss = 1.3614e-06, PNorm = 117.2310, GNorm = 0.0001, lr_0 = 9.2242e-04
Validation auc = 0.650766
Epoch 1562
Validation auc = 0.649567
Epoch 1563
Validation auc = 0.648749
Epoch 1564
Validation auc = 0.648476
Epoch 1565
Validation auc = 0.648476
Epoch 1566
Loss = 9.2193e-06, PNorm = 117.2316, GNorm = 0.0004, lr_0 = 9.2217e-04
Validation auc = 0.648967
Epoch 1567
Validation auc = 0.649512
Epoch 1568
Validation auc = 0.649785
Epoch 1569
Validation auc = 0.649185
Epoch 1570
Loss = 1.3929e-05, PNorm = 117.2324, GNorm = 0.0013, lr_0 = 9.2196e-04
Loss = 2.5233e-06, PNorm = 117.2325, GNorm = 0.0002, lr_0 = 9.2194e-04
Validation auc = 0.648585
Epoch 1571
Validation auc = 0.648749
Epoch 1572
Validation auc = 0.649076
Epoch 1573
Validation auc = 0.649676
Epoch 1574
Validation auc = 0.646623
Epoch 1575
Loss = 8.1060e-06, PNorm = 117.2330, GNorm = 0.0002, lr_0 = 9.2173e-04
Validation auc = 0.644933
Epoch 1576
Validation auc = 0.644497
Epoch 1577
Validation auc = 0.648204
Epoch 1578
Validation auc = 0.653165
Epoch 1579
Validation auc = 0.657635
Epoch 1580
Loss = 1.8006e-05, PNorm = 117.2347, GNorm = 0.0007, lr_0 = 9.2148e-04
Validation auc = 0.660088
Epoch 1581
Validation auc = 0.661996
Epoch 1582
Validation auc = 0.662433
Epoch 1583
Validation auc = 0.663250
Epoch 1584
Loss = 9.3420e-06, PNorm = 117.2362, GNorm = 0.0002, lr_0 = 9.2127e-04
Loss = 3.5918e-05, PNorm = 117.2363, GNorm = 0.0021, lr_0 = 9.2125e-04
Validation auc = 0.664232
Epoch 1585
Validation auc = 0.664504
Epoch 1586
Validation auc = 0.665104
Epoch 1587
Validation auc = 0.665049
Epoch 1588
Validation auc = 0.665049
Epoch 1589
Loss = 6.6636e-06, PNorm = 117.2375, GNorm = 0.0003, lr_0 = 9.2103e-04
Loss = 8.2650e-06, PNorm = 117.2375, GNorm = 0.0003, lr_0 = 9.2101e-04
Validation auc = 0.665049
Epoch 1590
Validation auc = 0.664722
Epoch 1591
Validation auc = 0.664450
Epoch 1592
Validation auc = 0.664341
Epoch 1593
Validation auc = 0.663904
Epoch 1594
Loss = 7.3859e-06, PNorm = 117.2383, GNorm = 0.0003, lr_0 = 9.2080e-04
Validation auc = 0.662651
Epoch 1595
Validation auc = 0.661451
Epoch 1596
Validation auc = 0.661015
Epoch 1597
Validation auc = 0.660306
Epoch 1598
Validation auc = 0.659870
Epoch 1599
Loss = 5.4621e-06, PNorm = 117.2391, GNorm = 0.0002, lr_0 = 9.2055e-04
Validation auc = 0.659652
Epoch 1600
Validation auc = 0.659216
Epoch 1601
Validation auc = 0.658889
Epoch 1602
Validation auc = 0.659489
Epoch 1603
Loss = 3.5765e-05, PNorm = 117.2404, GNorm = 0.0003, lr_0 = 9.2034e-04
Loss = 6.8345e-06, PNorm = 117.2407, GNorm = 0.0003, lr_0 = 9.2032e-04
Validation auc = 0.659216
Epoch 1604
Validation auc = 0.659761
Epoch 1605
Validation auc = 0.659761
Epoch 1606
Validation auc = 0.659979
Epoch 1607
Validation auc = 0.660470
Epoch 1608
Loss = 1.8172e-05, PNorm = 117.2439, GNorm = 0.0014, lr_0 = 9.2010e-04
Validation auc = 0.660852
Epoch 1609
Validation auc = 0.661233
Epoch 1610
Validation auc = 0.661560
Epoch 1611
Validation auc = 0.661506
Epoch 1612
Validation auc = 0.661451
Epoch 1613
Loss = 6.9235e-06, PNorm = 117.2459, GNorm = 0.0002, lr_0 = 9.1987e-04
Validation auc = 0.661288
Epoch 1614
Validation auc = 0.661233
Epoch 1615
Validation auc = 0.660961
Epoch 1616
Validation auc = 0.660252
Epoch 1617
Loss = 2.9242e-06, PNorm = 117.2470, GNorm = 0.0001, lr_0 = 9.1966e-04
Loss = 2.5829e-07, PNorm = 117.2470, GNorm = 0.0000, lr_0 = 9.1964e-04
Validation auc = 0.660143
Epoch 1618
Validation auc = 0.659652
Epoch 1619
Validation auc = 0.659271
Epoch 1620
Validation auc = 0.659271
Epoch 1621
Validation auc = 0.658834
Epoch 1622
Loss = 6.1484e-06, PNorm = 117.2479, GNorm = 0.0001, lr_0 = 9.1941e-04
Loss = 0.0000e+00, PNorm = 117.2479, GNorm = 0.0000, lr_0 = 9.1939e-04
Validation auc = 0.658453
Epoch 1623
Validation auc = 0.658344
Epoch 1624
Validation auc = 0.657962
Epoch 1625
Validation auc = 0.657744
Epoch 1626
Validation auc = 0.657635
Epoch 1627
Loss = 9.7969e-06, PNorm = 117.2484, GNorm = 0.0011, lr_0 = 9.1918e-04
Validation auc = 0.657253
Epoch 1628
Validation auc = 0.656327
Epoch 1629
Validation auc = 0.655182
Epoch 1630
Validation auc = 0.654091
Epoch 1631
Validation auc = 0.653383
Epoch 1632
Loss = 6.2704e-07, PNorm = 117.2491, GNorm = 0.0000, lr_0 = 9.1894e-04
Validation auc = 0.653110
Epoch 1633
Validation auc = 0.652783
Epoch 1634
Validation auc = 0.652729
Epoch 1635
Validation auc = 0.652565
Epoch 1636
Loss = 4.9898e-06, PNorm = 117.2496, GNorm = 0.0003, lr_0 = 9.1873e-04
Loss = 1.7087e-06, PNorm = 117.2497, GNorm = 0.0001, lr_0 = 9.1871e-04
Validation auc = 0.652238
Epoch 1637
Validation auc = 0.652292
Epoch 1638
Validation auc = 0.652183
Epoch 1639
Validation auc = 0.652074
Epoch 1640
Validation auc = 0.651911
Epoch 1641
Loss = 4.5715e-06, PNorm = 117.2500, GNorm = 0.0001, lr_0 = 9.1848e-04
Validation auc = 0.651802
Epoch 1642
Validation auc = 0.651584
Epoch 1643
Validation auc = 0.651529
Epoch 1644
Validation auc = 0.651311
Epoch 1645
Validation auc = 0.651475
Epoch 1646
Loss = 7.3859e-06, PNorm = 117.2504, GNorm = 0.0004, lr_0 = 9.1825e-04
Validation auc = 0.651202
Epoch 1647
Validation auc = 0.651093
Epoch 1648
Validation auc = 0.651093
Epoch 1649
Validation auc = 0.651093
Epoch 1650
Loss = 3.2411e-06, PNorm = 117.2507, GNorm = 0.0001, lr_0 = 9.1804e-04
Loss = 2.1855e-07, PNorm = 117.2508, GNorm = 0.0000, lr_0 = 9.1803e-04
Validation auc = 0.651039
Epoch 1651
Validation auc = 0.650930
Epoch 1652
Validation auc = 0.650820
Epoch 1653
Validation auc = 0.650657
Epoch 1654
Validation auc = 0.650493
Epoch 1655
Loss = 2.3112e-05, PNorm = 117.2513, GNorm = 0.0043, lr_0 = 9.1780e-04
Loss = 6.9737e-06, PNorm = 117.2513, GNorm = 0.0006, lr_0 = 9.1778e-04
Validation auc = 0.650766
Epoch 1656
Validation auc = 0.650602
Epoch 1657
Validation auc = 0.650875
Epoch 1658
Validation auc = 0.650820
Epoch 1659
Validation auc = 0.650766
Epoch 1660
Loss = 2.6226e-06, PNorm = 117.2519, GNorm = 0.0001, lr_0 = 9.1757e-04
Validation auc = 0.650766
Epoch 1661
Validation auc = 0.650875
Epoch 1662
Validation auc = 0.650439
Epoch 1663
Validation auc = 0.650275
Epoch 1664
Validation auc = 0.650112
Epoch 1665
Loss = 1.2803e-06, PNorm = 117.2524, GNorm = 0.0001, lr_0 = 9.1733e-04
Validation auc = 0.649948
Epoch 1666
Validation auc = 0.650003
Epoch 1667
Validation auc = 0.649894
Epoch 1668
Validation auc = 0.649948
Epoch 1669
Loss = 8.2071e-06, PNorm = 117.2527, GNorm = 0.0001, lr_0 = 9.1712e-04
Loss = 4.6690e-06, PNorm = 117.2527, GNorm = 0.0002, lr_0 = 9.1710e-04
Validation auc = 0.649785
Epoch 1670
Validation auc = 0.649567
Epoch 1671
Validation auc = 0.649294
Epoch 1672
Validation auc = 0.648912
Epoch 1673
Validation auc = 0.648749
Epoch 1674
Loss = 2.8908e-06, PNorm = 117.2530, GNorm = 0.0001, lr_0 = 9.1687e-04
Validation auc = 0.648803
Epoch 1675
Validation auc = 0.648640
Epoch 1676
Validation auc = 0.648531
Epoch 1677
Validation auc = 0.648640
Epoch 1678
Validation auc = 0.648531
Epoch 1679
Loss = 2.4819e-06, PNorm = 117.2534, GNorm = 0.0001, lr_0 = 9.1664e-04
Validation auc = 0.648476
Epoch 1680
Validation auc = 0.646895
Epoch 1681
Validation auc = 0.645914
Epoch 1682
Validation auc = 0.645042
Epoch 1683
Loss = 4.9904e-06, PNorm = 117.2540, GNorm = 0.0000, lr_0 = 9.1642e-04
Validation auc = 0.644933
Epoch 1684
Validation auc = 0.646950
Epoch 1685
Validation auc = 0.651638
Epoch 1686
Validation auc = 0.654419
Epoch 1687
Validation auc = 0.656872
Epoch 1688
Loss = 5.6537e-06, PNorm = 117.2547, GNorm = 0.0004, lr_0 = 9.1619e-04
Loss = 3.5763e-07, PNorm = 117.2547, GNorm = 0.0000, lr_0 = 9.1617e-04
Validation auc = 0.658671
Epoch 1689
Validation auc = 0.659652
Epoch 1690
Validation auc = 0.660470
Epoch 1691
Validation auc = 0.661124
Epoch 1692
Validation auc = 0.661615
Epoch 1693
Loss = 4.5345e-06, PNorm = 117.2555, GNorm = 0.0002, lr_0 = 9.1596e-04
Validation auc = 0.661996
Epoch 1694
Validation auc = 0.661833
Epoch 1695
Validation auc = 0.661724
Epoch 1696
Validation auc = 0.661724
Epoch 1697
Validation auc = 0.661778
Epoch 1698
Loss = 2.6536e-06, PNorm = 117.2561, GNorm = 0.0001, lr_0 = 9.1572e-04
Validation auc = 0.661669
Epoch 1699
Validation auc = 0.661669
Epoch 1700
Validation auc = 0.661615
Epoch 1701
Validation auc = 0.661615
Epoch 1702
Loss = 1.7095e-06, PNorm = 117.2566, GNorm = 0.0000, lr_0 = 9.1551e-04
Loss = 1.7881e-06, PNorm = 117.2566, GNorm = 0.0001, lr_0 = 9.1549e-04
Validation auc = 0.661397
Epoch 1703
Validation auc = 0.661397
Epoch 1704
Validation auc = 0.661288
Epoch 1705
Validation auc = 0.661070
Epoch 1706
Validation auc = 0.660906
Epoch 1707
Loss = 1.1182e-06, PNorm = 117.2571, GNorm = 0.0000, lr_0 = 9.1526e-04
Loss = 4.9471e-06, PNorm = 117.2571, GNorm = 0.0003, lr_0 = 9.1525e-04
Validation auc = 0.660797
Epoch 1708
Validation auc = 0.660361
Epoch 1709
Validation auc = 0.660088
Epoch 1710
Validation auc = 0.659870
Epoch 1711
Validation auc = 0.659707
Epoch 1712
Loss = 1.6689e-06, PNorm = 117.2577, GNorm = 0.0001, lr_0 = 9.1504e-04
Validation auc = 0.659107
Epoch 1713
Validation auc = 0.658889
Epoch 1714
Validation auc = 0.658671
Epoch 1715
Validation auc = 0.658398
Epoch 1716
Loss = 7.1586e-06, PNorm = 117.2584, GNorm = 0.0024, lr_0 = 9.1481e-04
Validation auc = 0.658289
Epoch 1717
Validation auc = 0.658017
Epoch 1718
Validation auc = 0.657853
Epoch 1719
Validation auc = 0.657690
Epoch 1720
Validation auc = 0.657417
Epoch 1721
Loss = 3.4890e-06, PNorm = 117.2590, GNorm = 0.0005, lr_0 = 9.1458e-04
Loss = 1.9868e-07, PNorm = 117.2590, GNorm = 0.0000, lr_0 = 9.1457e-04
Validation auc = 0.657199
Epoch 1722
Validation auc = 0.656981
Epoch 1723
Validation auc = 0.656599
Epoch 1724
Validation auc = 0.657308
Epoch 1725
Validation auc = 0.657308
Epoch 1726
Loss = 2.4271e-06, PNorm = 117.2594, GNorm = 0.0001, lr_0 = 9.1436e-04
Validation auc = 0.657308
Epoch 1727
Validation auc = 0.657472
Epoch 1728
Validation auc = 0.657417
Epoch 1729
Validation auc = 0.657308
Epoch 1730
Validation auc = 0.657199
Epoch 1731
Loss = 4.2819e-06, PNorm = 117.2601, GNorm = 0.0002, lr_0 = 9.1411e-04
Validation auc = 0.656926
Epoch 1732
Validation auc = 0.656763
Epoch 1733
Validation auc = 0.656327
Epoch 1734
Validation auc = 0.656218
Epoch 1735
Loss = 2.9015e-06, PNorm = 117.2606, GNorm = 0.0000, lr_0 = 9.1390e-04
Loss = 1.3709e-06, PNorm = 117.2606, GNorm = 0.0001, lr_0 = 9.1389e-04
Validation auc = 0.656000
Epoch 1736
Validation auc = 0.655727
Epoch 1737
Validation auc = 0.655509
Epoch 1738
Validation auc = 0.655291
Epoch 1739
Validation auc = 0.655182
Epoch 1740
Loss = 2.6059e-06, PNorm = 117.2611, GNorm = 0.0001, lr_0 = 9.1366e-04
Loss = 7.3512e-07, PNorm = 117.2611, GNorm = 0.0001, lr_0 = 9.1364e-04
Validation auc = 0.654855
Epoch 1741
Validation auc = 0.654582
Epoch 1742
Validation auc = 0.654582
Epoch 1743
Validation auc = 0.653546
Epoch 1744
Validation auc = 0.650003
Epoch 1745
Loss = 2.3961e-06, PNorm = 117.2619, GNorm = 0.0002, lr_0 = 9.1343e-04
Validation auc = 0.647659
Epoch 1746
Validation auc = 0.646023
Epoch 1747
Validation auc = 0.644333
Epoch 1748
Validation auc = 0.643188
Epoch 1749
Loss = 3.3203e-06, PNorm = 117.2628, GNorm = 0.0001, lr_0 = 9.1320e-04
Validation auc = 0.642643
Epoch 1750
Validation auc = 0.642098
Epoch 1751
Validation auc = 0.641716
Epoch 1752
Validation auc = 0.641825
Epoch 1753
Validation auc = 0.641934
Epoch 1754
Loss = 1.6629e-06, PNorm = 117.2634, GNorm = 0.0001, lr_0 = 9.1298e-04
Loss = 4.9471e-06, PNorm = 117.2634, GNorm = 0.0003, lr_0 = 9.1296e-04
Validation auc = 0.641934
Epoch 1755
Validation auc = 0.642152
Epoch 1756
Validation auc = 0.642043
Epoch 1757
Validation auc = 0.642043
Epoch 1758
Validation auc = 0.642370
Epoch 1759
Loss = 2.3126e-06, PNorm = 117.2639, GNorm = 0.0001, lr_0 = 9.1275e-04
Validation auc = 0.642534
Epoch 1760
Validation auc = 0.642643
Epoch 1761
Validation auc = 0.643134
Epoch 1762
Validation auc = 0.643079
Epoch 1763
Validation auc = 0.643297
Epoch 1764
Loss = 5.8889e-07, PNorm = 117.2643, GNorm = 0.0000, lr_0 = 9.1251e-04
Validation auc = 0.643461
Epoch 1765
Validation auc = 0.643624
Epoch 1766
Validation auc = 0.643679
Epoch 1767
Validation auc = 0.643679
Epoch 1768
Loss = 7.3194e-07, PNorm = 117.2646, GNorm = 0.0001, lr_0 = 9.1230e-04
Loss = 4.9670e-07, PNorm = 117.2647, GNorm = 0.0000, lr_0 = 9.1228e-04
Validation auc = 0.643733
Epoch 1769
Validation auc = 0.643733
Epoch 1770
Validation auc = 0.643679
Epoch 1771
Validation auc = 0.643733
Epoch 1772
Validation auc = 0.643461
Epoch 1773
Loss = 6.4611e-07, PNorm = 117.2650, GNorm = 0.0000, lr_0 = 9.1206e-04
Loss = 1.0927e-06, PNorm = 117.2650, GNorm = 0.0001, lr_0 = 9.1204e-04
Validation auc = 0.643134
Epoch 1774
Validation auc = 0.643406
Epoch 1775
Validation auc = 0.643079
Epoch 1776
Validation auc = 0.643188
Epoch 1777
Validation auc = 0.643461
Epoch 1778
Loss = 5.9984e-06, PNorm = 117.2653, GNorm = 0.0007, lr_0 = 9.1183e-04
Validation auc = 0.643352
Epoch 1779
Validation auc = 0.643243
Epoch 1780
Validation auc = 0.643461
Epoch 1781
Validation auc = 0.643624
Epoch 1782
Validation auc = 0.643788
Epoch 1783
Loss = 4.1291e-06, PNorm = 117.2657, GNorm = 0.0004, lr_0 = 9.1159e-04
Validation auc = 0.644115
Epoch 1784
Validation auc = 0.644388
Epoch 1785
Validation auc = 0.644442
Epoch 1786
Validation auc = 0.644442
Epoch 1787
Loss = 8.4399e-07, PNorm = 117.2659, GNorm = 0.0001, lr_0 = 9.1138e-04
Loss = 5.9605e-07, PNorm = 117.2659, GNorm = 0.0001, lr_0 = 9.1136e-04
Validation auc = 0.644333
Epoch 1788
Validation auc = 0.644060
Epoch 1789
Validation auc = 0.643733
Epoch 1790
Validation auc = 0.643570
Epoch 1791
Validation auc = 0.643297
Epoch 1792
Loss = 3.8385e-07, PNorm = 117.2661, GNorm = 0.0000, lr_0 = 9.1115e-04
Validation auc = 0.643297
Epoch 1793
Validation auc = 0.643243
Epoch 1794
Validation auc = 0.643243
Epoch 1795
Validation auc = 0.643243
Epoch 1796
Validation auc = 0.643352
Epoch 1797
Loss = 2.7418e-06, PNorm = 117.2663, GNorm = 0.0002, lr_0 = 9.1091e-04
Validation auc = 0.643352
Epoch 1798
Validation auc = 0.643352
Epoch 1799
Validation auc = 0.643297
Epoch 1800
Validation auc = 0.643352
Epoch 1801
Loss = 6.8307e-07, PNorm = 117.2665, GNorm = 0.0001, lr_0 = 9.1070e-04
Loss = 0.0000e+00, PNorm = 117.2665, GNorm = 0.0000, lr_0 = 9.1068e-04
Validation auc = 0.643515
Epoch 1802
Validation auc = 0.643679
Epoch 1803
Validation auc = 0.643679
Epoch 1804
Validation auc = 0.643842
Epoch 1805
Validation auc = 0.643951
Epoch 1806
Loss = 7.3864e-06, PNorm = 117.2668, GNorm = 0.0020, lr_0 = 9.1046e-04
Loss = 1.7881e-06, PNorm = 117.2669, GNorm = 0.0002, lr_0 = 9.1044e-04
Validation auc = 0.643679
Epoch 1807
Validation auc = 0.643570
Epoch 1808
Validation auc = 0.643570
Epoch 1809
Validation auc = 0.643297
Epoch 1810
Validation auc = 0.643188
Epoch 1811
Loss = 5.1136e-06, PNorm = 117.2672, GNorm = 0.0005, lr_0 = 9.1023e-04
Validation auc = 0.643515
Epoch 1812
Validation auc = 0.643733
Epoch 1813
Validation auc = 0.643515
Epoch 1814
Validation auc = 0.643679
Epoch 1815
Validation auc = 0.643352
Epoch 1816
Loss = 8.5115e-07, PNorm = 117.2675, GNorm = 0.0000, lr_0 = 9.0999e-04
Validation auc = 0.643079
Epoch 1817
Validation auc = 0.642916
Epoch 1818
Validation auc = 0.642970
Epoch 1819
Validation auc = 0.642916
Epoch 1820
Loss = 2.0122e-06, PNorm = 117.2677, GNorm = 0.0000, lr_0 = 9.0978e-04
Loss = 1.9868e-07, PNorm = 117.2677, GNorm = 0.0000, lr_0 = 9.0976e-04
Validation auc = 0.643134
Epoch 1821
Validation auc = 0.643188
Epoch 1822
Validation auc = 0.643406
Epoch 1823
Validation auc = 0.643352
Epoch 1824
Validation auc = 0.643297
Epoch 1825
Loss = 3.8624e-07, PNorm = 117.2679, GNorm = 0.0000, lr_0 = 9.0955e-04
Validation auc = 0.643570
Epoch 1826
Validation auc = 0.644497
Epoch 1827
Validation auc = 0.644660
Epoch 1828
Validation auc = 0.644987
Epoch 1829
Validation auc = 0.645260
Epoch 1830
Loss = 1.8954e-06, PNorm = 117.2683, GNorm = 0.0001, lr_0 = 9.0931e-04
Validation auc = 0.645260
Epoch 1831
Validation auc = 0.645314
Epoch 1832
Validation auc = 0.645423
Epoch 1833
Validation auc = 0.645369
Epoch 1834
Loss = 5.0664e-07, PNorm = 117.2685, GNorm = 0.0000, lr_0 = 9.0910e-04
Loss = 1.9868e-08, PNorm = 117.2686, GNorm = 0.0000, lr_0 = 9.0909e-04
Validation auc = 0.645260
Epoch 1835
Validation auc = 0.645314
Epoch 1836
Validation auc = 0.645369
Epoch 1837
Validation auc = 0.645314
Epoch 1838
Validation auc = 0.645587
Epoch 1839
Loss = 1.2743e-06, PNorm = 117.2688, GNorm = 0.0002, lr_0 = 9.0886e-04
Loss = 6.9539e-07, PNorm = 117.2688, GNorm = 0.0000, lr_0 = 9.0884e-04
Validation auc = 0.646023
Epoch 1840
Validation auc = 0.646568
Epoch 1841
Validation auc = 0.646841
Epoch 1842
Validation auc = 0.646677
Epoch 1843
Validation auc = 0.645750
Epoch 1844
Loss = 3.1184e-06, PNorm = 117.2690, GNorm = 0.0003, lr_0 = 9.0863e-04
Validation auc = 0.643788
Epoch 1845
Validation auc = 0.643079
Epoch 1846
Validation auc = 0.643025
Epoch 1847
Validation auc = 0.642697
Epoch 1848
Validation auc = 0.642479
Epoch 1849
Loss = 2.6726e-06, PNorm = 117.2695, GNorm = 0.0001, lr_0 = 9.0839e-04
Validation auc = 0.642588
Epoch 1850
Validation auc = 0.643025
Epoch 1851
Validation auc = 0.643679
Epoch 1852
Validation auc = 0.643951
Epoch 1853
Loss = 1.5545e-06, PNorm = 117.2699, GNorm = 0.0001, lr_0 = 9.0818e-04
Loss = 2.8411e-06, PNorm = 117.2699, GNorm = 0.0001, lr_0 = 9.0817e-04
Validation auc = 0.644115
Epoch 1854
Validation auc = 0.644497
Epoch 1855
Validation auc = 0.644606
Epoch 1856
Validation auc = 0.644824
Epoch 1857
Validation auc = 0.645042
Epoch 1858
Loss = 2.9002e-06, PNorm = 117.2703, GNorm = 0.0002, lr_0 = 9.0794e-04
Validation auc = 0.645042
Epoch 1859
Validation auc = 0.645096
Epoch 1860
Validation auc = 0.645151
Epoch 1861
Validation auc = 0.645369
Epoch 1862
Validation auc = 0.645532
Epoch 1863
Loss = 2.2578e-06, PNorm = 117.2706, GNorm = 0.0001, lr_0 = 9.0772e-04
Validation auc = 0.646023
Epoch 1864
Validation auc = 0.646841
Epoch 1865
Validation auc = 0.649130
Epoch 1866
Validation auc = 0.652565
Epoch 1867
Loss = 1.1906e-05, PNorm = 117.2730, GNorm = 0.0009, lr_0 = 9.0751e-04
Loss = 3.9140e-06, PNorm = 117.2732, GNorm = 0.0004, lr_0 = 9.0749e-04
Validation auc = 0.656381
Epoch 1868
Validation auc = 0.660961
Epoch 1869
Validation auc = 0.664286
Epoch 1870
Validation auc = 0.667557
Epoch 1871
Validation auc = 0.669356
Epoch 1872
Loss = 5.1139e-06, PNorm = 117.2756, GNorm = 0.0003, lr_0 = 9.0727e-04
Loss = 4.0928e-06, PNorm = 117.2758, GNorm = 0.0002, lr_0 = 9.0725e-04
Validation auc = 0.670065
Epoch 1873
Validation auc = 0.670992
Epoch 1874
Validation auc = 0.671973
Epoch 1875
Validation auc = 0.672137
Epoch 1876
Validation auc = 0.672464
Epoch 1877
Loss = 6.8993e-06, PNorm = 117.2770, GNorm = 0.0003, lr_0 = 9.0704e-04
Validation auc = 0.672682
Epoch 1878
Validation auc = 0.673990
Epoch 1879
Validation auc = 0.674535
Epoch 1880
Validation auc = 0.674808
Epoch 1881
Validation auc = 0.674862
Epoch 1882
Loss = 4.0411e-06, PNorm = 117.2778, GNorm = 0.0001, lr_0 = 9.0680e-04
Validation auc = 0.674917
Epoch 1883
Validation auc = 0.675189
Epoch 1884
Validation auc = 0.675353
Epoch 1885
Validation auc = 0.675462
Epoch 1886
Loss = 3.7860e-06, PNorm = 117.2785, GNorm = 0.0002, lr_0 = 9.0659e-04
Loss = 3.0199e-06, PNorm = 117.2785, GNorm = 0.0002, lr_0 = 9.0657e-04
Validation auc = 0.675353
Epoch 1887
Validation auc = 0.675189
Epoch 1888
Validation auc = 0.675244
Epoch 1889
Validation auc = 0.675080
Epoch 1890
Validation auc = 0.675026
Epoch 1891
Loss = 5.1831e-05, PNorm = 117.2791, GNorm = 0.0117, lr_0 = 9.0635e-04
Validation auc = 0.674971
Epoch 1892
Validation auc = 0.674317
Epoch 1893
Validation auc = 0.674372
Epoch 1894
Validation auc = 0.673936
Epoch 1895
Validation auc = 0.673009
Epoch 1896
Loss = 9.0122e-07, PNorm = 117.2795, GNorm = 0.0000, lr_0 = 9.0612e-04
Validation auc = 0.672573
Epoch 1897
Validation auc = 0.672573
Epoch 1898
Validation auc = 0.672573
Epoch 1899
Validation auc = 0.672409
Epoch 1900
Loss = 3.7037e-06, PNorm = 117.2800, GNorm = 0.0001, lr_0 = 9.0592e-04
Loss = 1.5895e-07, PNorm = 117.2800, GNorm = 0.0000, lr_0 = 9.0590e-04
Validation auc = 0.672355
Epoch 1901
Validation auc = 0.672137
Epoch 1902
Validation auc = 0.672082
Epoch 1903
Validation auc = 0.671755
Epoch 1904
Validation auc = 0.671537
Epoch 1905
Loss = 2.4402e-06, PNorm = 117.2805, GNorm = 0.0001, lr_0 = 9.0567e-04
Loss = 2.5829e-07, PNorm = 117.2805, GNorm = 0.0000, lr_0 = 9.0566e-04
Validation auc = 0.671319
Epoch 1906
Validation auc = 0.671319
Epoch 1907
Validation auc = 0.671319
Epoch 1908
Validation auc = 0.671155
Epoch 1909
Validation auc = 0.671155
Epoch 1910
Loss = 1.9598e-06, PNorm = 117.2810, GNorm = 0.0001, lr_0 = 9.0545e-04
Validation auc = 0.670937
Epoch 1911
Validation auc = 0.670665
Epoch 1912
Validation auc = 0.670665
Epoch 1913
Validation auc = 0.670610
Epoch 1914
Validation auc = 0.670446
Epoch 1915
Loss = 1.0872e-06, PNorm = 117.2817, GNorm = 0.0001, lr_0 = 9.0521e-04
Validation auc = 0.670283
Epoch 1916
Validation auc = 0.670446
Epoch 1917
Validation auc = 0.670119
Epoch 1918
Validation auc = 0.670174
Epoch 1919
Loss = 2.0742e-06, PNorm = 117.2821, GNorm = 0.0000, lr_0 = 9.0500e-04
Loss = 3.0994e-06, PNorm = 117.2822, GNorm = 0.0002, lr_0 = 9.0498e-04
Validation auc = 0.670283
Epoch 1920
Validation auc = 0.669956
Epoch 1921
Validation auc = 0.670010
Epoch 1922
Validation auc = 0.669356
Epoch 1923
Validation auc = 0.669356
Epoch 1924
Loss = 2.2280e-06, PNorm = 117.2828, GNorm = 0.0000, lr_0 = 9.0476e-04
Validation auc = 0.669356
Epoch 1925
Validation auc = 0.669193
Epoch 1926
Validation auc = 0.669029
Epoch 1927
Validation auc = 0.668866
Epoch 1928
Validation auc = 0.668866
Epoch 1929
Loss = 5.9364e-06, PNorm = 117.2833, GNorm = 0.0002, lr_0 = 9.0454e-04
Validation auc = 0.668920
Epoch 1930
Validation auc = 0.668866
Epoch 1931
Validation auc = 0.668920
Epoch 1932
Validation auc = 0.668920
Epoch 1933
Loss = 1.6877e-06, PNorm = 117.2837, GNorm = 0.0002, lr_0 = 9.0431e-04
Validation auc = 0.669084
Epoch 1934
Validation auc = 0.669029
Epoch 1935
Validation auc = 0.668866
Epoch 1936
Validation auc = 0.668593
Epoch 1937
Validation auc = 0.668429
Epoch 1938
Loss = 3.4999e-06, PNorm = 117.2841, GNorm = 0.0003, lr_0 = 9.0409e-04
Loss = 5.1657e-07, PNorm = 117.2841, GNorm = 0.0000, lr_0 = 9.0407e-04
Validation auc = 0.668320
Epoch 1939
Validation auc = 0.668266
Epoch 1940
Validation auc = 0.668157
Epoch 1941
Validation auc = 0.668102
Epoch 1942
Validation auc = 0.667939
Epoch 1943
Loss = 8.5592e-07, PNorm = 117.2844, GNorm = 0.0000, lr_0 = 9.0386e-04
Validation auc = 0.667993
Epoch 1944
Validation auc = 0.667884
Epoch 1945
Validation auc = 0.667884
Epoch 1946
Validation auc = 0.667721
Epoch 1947
Validation auc = 0.667339
Epoch 1948
Loss = 8.3923e-07, PNorm = 117.2848, GNorm = 0.0000, lr_0 = 9.0362e-04
Validation auc = 0.667285
Epoch 1949
Validation auc = 0.667121
Epoch 1950
Validation auc = 0.666848
Epoch 1951
Validation auc = 0.666685
Epoch 1952
Loss = 2.3090e-06, PNorm = 117.2852, GNorm = 0.0001, lr_0 = 9.0341e-04
Loss = 5.4239e-06, PNorm = 117.2853, GNorm = 0.0010, lr_0 = 9.0340e-04
Validation auc = 0.666467
Epoch 1953
Validation auc = 0.666412
Epoch 1954
Validation auc = 0.666303
Epoch 1955
Validation auc = 0.666303
Epoch 1956
Validation auc = 0.666194
Epoch 1957
Loss = 1.3399e-06, PNorm = 117.2857, GNorm = 0.0001, lr_0 = 9.0317e-04
Loss = 1.0331e-06, PNorm = 117.2857, GNorm = 0.0001, lr_0 = 9.0316e-04
Validation auc = 0.666140
Epoch 1958
Validation auc = 0.666140
Epoch 1959
Validation auc = 0.665922
Epoch 1960
Validation auc = 0.665813
Epoch 1961
Validation auc = 0.665867
Epoch 1962
Loss = 1.2851e-06, PNorm = 117.2860, GNorm = 0.0001, lr_0 = 9.0295e-04
Validation auc = 0.665813
Epoch 1963
Validation auc = 0.665595
Epoch 1964
Validation auc = 0.665431
Epoch 1965
Validation auc = 0.665540
Epoch 1966
Loss = 9.1075e-07, PNorm = 117.2863, GNorm = 0.0000, lr_0 = 9.0273e-04
Validation auc = 0.665376
Epoch 1967
Validation auc = 0.665322
Epoch 1968
Validation auc = 0.664886
Epoch 1969
Validation auc = 0.664341
Epoch 1970
Validation auc = 0.663959
Epoch 1971
Loss = 1.4102e-06, PNorm = 117.2867, GNorm = 0.0001, lr_0 = 9.0250e-04
Loss = 2.1855e-07, PNorm = 117.2867, GNorm = 0.0000, lr_0 = 9.0249e-04
Validation auc = 0.663904
Epoch 1972
Validation auc = 0.664014
Epoch 1973
Validation auc = 0.663959
Epoch 1974
Validation auc = 0.663741
Epoch 1975
Validation auc = 0.663523
Epoch 1976
Loss = 1.6951e-06, PNorm = 117.2870, GNorm = 0.0001, lr_0 = 9.0228e-04
Validation auc = 0.663632
Epoch 1977
Validation auc = 0.663523
Epoch 1978
Validation auc = 0.663359
Epoch 1979
Validation auc = 0.663414
Epoch 1980
Validation auc = 0.663414
Epoch 1981
Loss = 7.8439e-07, PNorm = 117.2872, GNorm = 0.0000, lr_0 = 9.0204e-04
Validation auc = 0.663468
Epoch 1982
Validation auc = 0.663087
Epoch 1983
Validation auc = 0.663196
Epoch 1984
Validation auc = 0.662814
Epoch 1985
Loss = 1.1909e-06, PNorm = 117.2875, GNorm = 0.0000, lr_0 = 9.0183e-04
Loss = 4.7684e-07, PNorm = 117.2875, GNorm = 0.0000, lr_0 = 9.0181e-04
Validation auc = 0.662542
Epoch 1986
Validation auc = 0.662269
Epoch 1987
Validation auc = 0.662160
Epoch 1988
Validation auc = 0.662051
Epoch 1989
Validation auc = 0.661996
Epoch 1990
Loss = 1.2207e-06, PNorm = 117.2879, GNorm = 0.0001, lr_0 = 9.0159e-04
Loss = 7.9473e-08, PNorm = 117.2879, GNorm = 0.0000, lr_0 = 9.0157e-04
Validation auc = 0.661887
Epoch 1991
Validation auc = 0.661669
Epoch 1992
Validation auc = 0.661724
Epoch 1993
Validation auc = 0.661724
Epoch 1994
Validation auc = 0.661833
Epoch 1995
Loss = 8.5115e-07, PNorm = 117.2882, GNorm = 0.0000, lr_0 = 9.0137e-04
Validation auc = 0.661833
Epoch 1996
Validation auc = 0.661942
Epoch 1997
Validation auc = 0.661942
Epoch 1998
Validation auc = 0.661996
Epoch 1999
Loss = 1.4543e-06, PNorm = 117.2884, GNorm = 0.0001, lr_0 = 9.0114e-04
Validation auc = 0.661996
Model 0 best validation auc = 0.747642 on epoch 217
Loading pretrained parameter "encoder.encoder.0.cached_zero_vector".
Loading pretrained parameter "encoder.encoder.0.W_i.weight".
Loading pretrained parameter "encoder.encoder.0.W_h.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.bias".
Loading pretrained parameter "ffn.1.weight".
Loading pretrained parameter "ffn.1.bias".
Moving model to cuda
Model 0 test auc = 0.676478
Ensemble test auc = 0.676478
Fold 6
Splitting data with seed 6
Class sizes
sars_cov_two_active 0: 98.39%, 1: 1.61%
Total size = 3,294 | train size = 3,294 | val size = 1,096 | test size = 1,086
With class_balance, effective train size = 106
Building model 0
MoleculeModel(
  (sigmoid): Sigmoid()
  (encoder): MPN(
    (encoder): ModuleList(
      (0): MPNEncoder(
        (dropout_layer): Dropout(p=0.05, inplace=False)
        (act_func): ReLU()
        (W_i): Linear(in_features=147, out_features=2100, bias=False)
        (W_h): Linear(in_features=2100, out_features=2100, bias=False)
        (W_o): Linear(in_features=2233, out_features=2100, bias=True)
      )
    )
  )
  (ffn): Sequential(
    (0): Dropout(p=0.05, inplace=False)
    (1): Linear(in_features=2328, out_features=1, bias=True)
  )
)
Number of parameters = 9,412,429
Moving model to cuda
Epoch 0
Validation auc = 0.520307
Epoch 1
Validation auc = 0.645151
Epoch 2
Validation auc = 0.624325
Epoch 3
Validation auc = 0.643788
Epoch 4
Loss = 6.9619e-01, PNorm = 67.4105, GNorm = 1.1555, lr_0 = 2.0385e-04
Loss = 7.1925e-01, PNorm = 67.4128, GNorm = 3.7872, lr_0 = 2.1077e-04
Validation auc = 0.678188
Epoch 5
Validation auc = 0.638554
Epoch 6
Validation auc = 0.655836
Epoch 7
Validation auc = 0.661887
Epoch 8
Validation auc = 0.668211
Epoch 9
Loss = 6.8563e-01, PNorm = 67.4534, GNorm = 1.6881, lr_0 = 3.0077e-04
Validation auc = 0.694270
Epoch 10
Validation auc = 0.667775
Epoch 11
Validation auc = 0.690509
Epoch 12
Validation auc = 0.669356
Epoch 13
Validation auc = 0.672845
Epoch 14
Loss = 6.7424e-01, PNorm = 67.5274, GNorm = 0.7762, lr_0 = 4.0462e-04
Validation auc = 0.663904
Epoch 15
Validation auc = 0.643243
Epoch 16
Validation auc = 0.625852
Epoch 17
Validation auc = 0.631576
Epoch 18
Loss = 6.5191e-01, PNorm = 67.5982, GNorm = 0.6827, lr_0 = 4.9462e-04
Loss = 5.5617e-01, PNorm = 67.6052, GNorm = 2.1282, lr_0 = 5.0154e-04
Validation auc = 0.634193
Epoch 19
Validation auc = 0.633593
Epoch 20
Validation auc = 0.644715
Epoch 21
Validation auc = 0.665758
Epoch 22
Validation auc = 0.675789
Epoch 23
Loss = 6.7023e-01, PNorm = 67.7524, GNorm = 1.4515, lr_0 = 5.9846e-04
Loss = 3.3652e-01, PNorm = 67.7657, GNorm = 1.7897, lr_0 = 6.0538e-04
Validation auc = 0.682985
Epoch 24
Validation auc = 0.686965
Epoch 25
Validation auc = 0.666739
Epoch 26
Validation auc = 0.657199
Epoch 27
Validation auc = 0.642916
Epoch 28
Loss = 6.7488e-01, PNorm = 67.9335, GNorm = 1.3554, lr_0 = 6.9538e-04
Validation auc = 0.627651
Epoch 29
Validation auc = 0.625089
Epoch 30
Validation auc = 0.625252
Epoch 31
Validation auc = 0.598648
Epoch 32
Validation auc = 0.559723
Epoch 33
Loss = 5.8956e-01, PNorm = 68.1761, GNorm = 2.1524, lr_0 = 7.9923e-04
Validation auc = 0.618547
Epoch 34
Validation auc = 0.620455
Epoch 35
Validation auc = 0.628469
Epoch 36
Validation auc = 0.635937
Epoch 37
Loss = 5.2453e-01, PNorm = 68.4871, GNorm = 1.2426, lr_0 = 8.8923e-04
Loss = 5.9549e-01, PNorm = 68.5122, GNorm = 3.6638, lr_0 = 8.9615e-04
Validation auc = 0.632994
Epoch 38
Validation auc = 0.612986
Epoch 39
Validation auc = 0.604590
Epoch 40
Validation auc = 0.598703
Epoch 41
Validation auc = 0.602355
Epoch 42
Loss = 5.8980e-01, PNorm = 68.8930, GNorm = 2.6624, lr_0 = 9.8615e-04
Validation auc = 0.540969
Epoch 43
Validation auc = 0.567682
Epoch 44
Validation auc = 0.581584
Epoch 45
Validation auc = 0.592270
Epoch 46
Validation auc = 0.609115
Epoch 47
Loss = 4.6536e-01, PNorm = 69.4436, GNorm = 0.5954, lr_0 = 9.9977e-04
Validation auc = 0.610042
Epoch 48
Validation auc = 0.596195
Epoch 49
Validation auc = 0.625416
Epoch 50
Validation auc = 0.648422
Epoch 51
Loss = 5.3194e-01, PNorm = 69.9283, GNorm = 1.5541, lr_0 = 9.9954e-04
Loss = 8.0032e-01, PNorm = 69.9592, GNorm = 2.9885, lr_0 = 9.9952e-04
Validation auc = 0.629395
Epoch 52
Validation auc = 0.624761
Epoch 53
Validation auc = 0.622744
Epoch 54
Validation auc = 0.624707
Epoch 55
Validation auc = 0.609933
Epoch 56
Loss = 4.7364e-01, PNorm = 70.5337, GNorm = 0.6509, lr_0 = 9.9927e-04
Loss = 3.9316e-01, PNorm = 70.5756, GNorm = 2.0896, lr_0 = 9.9926e-04
Validation auc = 0.614458
Epoch 57
Validation auc = 0.622908
Epoch 58
Validation auc = 0.629559
Epoch 59
Validation auc = 0.639481
Epoch 60
Validation auc = 0.635392
Epoch 61
Loss = 4.2060e-01, PNorm = 71.1151, GNorm = 1.2846, lr_0 = 9.9903e-04
Validation auc = 0.627923
Epoch 62
Validation auc = 0.610587
Epoch 63
Validation auc = 0.612550
Epoch 64
Validation auc = 0.594341
Epoch 65
Validation auc = 0.577386
Epoch 66
Loss = 3.7235e-01, PNorm = 71.7671, GNorm = 1.3023, lr_0 = 9.9876e-04
Validation auc = 0.579894
Epoch 67
Validation auc = 0.620128
Epoch 68
Validation auc = 0.641171
Epoch 69
Validation auc = 0.619146
Epoch 70
Loss = 4.2406e-01, PNorm = 72.4392, GNorm = 1.2355, lr_0 = 9.9853e-04
Loss = 6.0347e-01, PNorm = 72.4977, GNorm = 2.1962, lr_0 = 9.9851e-04
Validation auc = 0.622908
Epoch 71
Validation auc = 0.614676
Epoch 72
Validation auc = 0.651257
Epoch 73
Validation auc = 0.673881
Epoch 74
Validation auc = 0.669411
Epoch 75
Loss = 4.7405e-01, PNorm = 73.2069, GNorm = 1.1230, lr_0 = 9.9828e-04
Validation auc = 0.630595
Epoch 76
Validation auc = 0.596086
Epoch 77
Validation auc = 0.579240
Epoch 78
Validation auc = 0.622254
Epoch 79
Validation auc = 0.626342
Epoch 80
Loss = 3.9502e-01, PNorm = 74.0787, GNorm = 0.8568, lr_0 = 9.9802e-04
Validation auc = 0.623835
Epoch 81
Validation auc = 0.621272
Epoch 82
Validation auc = 0.624652
Epoch 83
Validation auc = 0.637409
Epoch 84
Loss = 2.6952e-01, PNorm = 74.8658, GNorm = 1.4155, lr_0 = 9.9779e-04
Loss = 5.7302e-02, PNorm = 74.9228, GNorm = 0.6342, lr_0 = 9.9777e-04
Validation auc = 0.653219
Epoch 85
Validation auc = 0.630813
Epoch 86
Validation auc = 0.617565
Epoch 87
Validation auc = 0.587799
Epoch 88
Validation auc = 0.576242
Epoch 89
Loss = 2.0969e-01, PNorm = 75.7197, GNorm = 2.5414, lr_0 = 9.9752e-04
Loss = 7.4363e-02, PNorm = 75.7807, GNorm = 1.0646, lr_0 = 9.9750e-04
Validation auc = 0.553454
Epoch 90
Validation auc = 0.576841
Epoch 91
Validation auc = 0.626452
Epoch 92
Validation auc = 0.621981
Epoch 93
Validation auc = 0.623780
Epoch 94
Loss = 3.0144e-01, PNorm = 76.5915, GNorm = 0.9742, lr_0 = 9.9727e-04
Validation auc = 0.563430
Epoch 95
Validation auc = 0.567901
Epoch 96
Validation auc = 0.623453
Epoch 97
Validation auc = 0.631140
Epoch 98
Validation auc = 0.627106
Epoch 99
Loss = 1.7623e-01, PNorm = 77.4237, GNorm = 0.8725, lr_0 = 9.9701e-04
Validation auc = 0.644933
Epoch 100
Validation auc = 0.629668
Epoch 101
Validation auc = 0.609333
Epoch 102
Validation auc = 0.597830
Epoch 103
Loss = 3.2611e-01, PNorm = 78.0174, GNorm = 0.6303, lr_0 = 9.9678e-04
Loss = 1.4860e-01, PNorm = 78.0677, GNorm = 3.7823, lr_0 = 9.9676e-04
Validation auc = 0.606880
Epoch 104
Validation auc = 0.597503
Epoch 105
Validation auc = 0.645641
Epoch 106
Validation auc = 0.636428
Epoch 107
Validation auc = 0.599520
Epoch 108
Loss = 2.3361e-01, PNorm = 78.7571, GNorm = 4.9321, lr_0 = 9.9651e-04
Validation auc = 0.617238
Epoch 109
Validation auc = 0.628523
Epoch 110
Validation auc = 0.635774
Epoch 111
Validation auc = 0.634847
Epoch 112
Validation auc = 0.650493
Epoch 113
Loss = 1.7310e-01, PNorm = 79.4601, GNorm = 1.0042, lr_0 = 9.9627e-04
Validation auc = 0.657362
Epoch 114
Validation auc = 0.645423
Epoch 115
Validation auc = 0.624761
Epoch 116
Validation auc = 0.604808
Epoch 117
Loss = 1.6936e-01, PNorm = 80.0544, GNorm = 1.5019, lr_0 = 9.9604e-04
Loss = 5.9687e-02, PNorm = 80.0939, GNorm = 0.8360, lr_0 = 9.9602e-04
Validation auc = 0.625416
Epoch 118
Validation auc = 0.639317
Epoch 119
Validation auc = 0.641062
Epoch 120
Validation auc = 0.637355
Epoch 121
Validation auc = 0.627051
Epoch 122
Loss = 1.3293e-01, PNorm = 80.6474, GNorm = 1.2769, lr_0 = 9.9577e-04
Loss = 2.1768e-02, PNorm = 80.6811, GNorm = 0.2554, lr_0 = 9.9575e-04
Validation auc = 0.620618
Epoch 123
Validation auc = 0.616693
Epoch 124
Validation auc = 0.619146
Epoch 125
Validation auc = 0.616638
Epoch 126
Validation auc = 0.594668
Epoch 127
Loss = 1.7285e-01, PNorm = 81.0827, GNorm = 1.5961, lr_0 = 9.9552e-04
Validation auc = 0.613477
Epoch 128
Validation auc = 0.620782
Epoch 129
Validation auc = 0.632067
Epoch 130
Validation auc = 0.647113
Epoch 131
Validation auc = 0.634465
Epoch 132
Loss = 8.1301e-02, PNorm = 81.6604, GNorm = 0.7828, lr_0 = 9.9526e-04
Validation auc = 0.626561
Epoch 133
Validation auc = 0.611350
Epoch 134
Validation auc = 0.615276
Epoch 135
Validation auc = 0.625525
Epoch 136
Loss = 1.7682e-01, PNorm = 82.2717, GNorm = 1.9976, lr_0 = 9.9503e-04
Loss = 6.6857e-02, PNorm = 82.3182, GNorm = 2.9383, lr_0 = 9.9501e-04
Validation auc = 0.627869
Epoch 137
Validation auc = 0.617129
Epoch 138
Validation auc = 0.590416
Epoch 139
Validation auc = 0.594069
Epoch 140
Validation auc = 0.597939
Epoch 141
Loss = 1.5490e-01, PNorm = 82.9833, GNorm = 1.5296, lr_0 = 9.9477e-04
Validation auc = 0.594287
Epoch 142
Validation auc = 0.585346
Epoch 143
Validation auc = 0.581039
Epoch 144
Validation auc = 0.589053
Epoch 145
Validation auc = 0.600447
Epoch 146
Loss = 1.8941e-01, PNorm = 83.5314, GNorm = 0.9441, lr_0 = 9.9452e-04
Validation auc = 0.611568
Epoch 147
Validation auc = 0.618492
Epoch 148
Validation auc = 0.616911
Epoch 149
Validation auc = 0.624325
Epoch 150
Loss = 1.0130e-01, PNorm = 83.9127, GNorm = 1.3496, lr_0 = 9.9429e-04
Loss = 1.6486e-02, PNorm = 83.9365, GNorm = 0.3863, lr_0 = 9.9427e-04
Validation auc = 0.612277
Epoch 151
Validation auc = 0.604972
Epoch 152
Validation auc = 0.599956
Epoch 153
Validation auc = 0.588726
Epoch 154
Validation auc = 0.558960
Epoch 155
Loss = 1.4913e-01, PNorm = 84.2292, GNorm = 2.0194, lr_0 = 9.9403e-04
Loss = 1.0438e-02, PNorm = 84.2467, GNorm = 0.2128, lr_0 = 9.9401e-04
Validation auc = 0.565556
Epoch 156
Validation auc = 0.580167
Epoch 157
Validation auc = 0.571390
Epoch 158
Validation auc = 0.570626
Epoch 159
Validation auc = 0.585837
Epoch 160
Loss = 1.0153e-01, PNorm = 84.5609, GNorm = 0.8536, lr_0 = 9.9378e-04
Validation auc = 0.593414
Epoch 161
Validation auc = 0.595650
Epoch 162
Validation auc = 0.587418
Epoch 163
Validation auc = 0.576351
Epoch 164
Validation auc = 0.575915
Epoch 165
Loss = 3.6758e-02, PNorm = 84.8855, GNorm = 0.4330, lr_0 = 9.9351e-04
Validation auc = 0.572371
Epoch 166
Validation auc = 0.557924
Epoch 167
Validation auc = 0.570190
Epoch 168
Validation auc = 0.585128
Epoch 169
Loss = 4.3009e-02, PNorm = 85.1184, GNorm = 0.4714, lr_0 = 9.9329e-04
Loss = 2.6550e-02, PNorm = 85.1347, GNorm = 0.7953, lr_0 = 9.9327e-04
Validation auc = 0.591234
Epoch 170
Validation auc = 0.584528
Epoch 171
Validation auc = 0.582129
Epoch 172
Validation auc = 0.595050
Epoch 173
Validation auc = 0.598921
Epoch 174
Loss = 4.3949e-02, PNorm = 85.3974, GNorm = 0.6452, lr_0 = 9.9302e-04
Validation auc = 0.594014
Epoch 175
Validation auc = 0.582184
Epoch 176
Validation auc = 0.577005
Epoch 177
Validation auc = 0.576787
Epoch 178
Validation auc = 0.576623
Epoch 179
Loss = 4.4307e-02, PNorm = 85.6522, GNorm = 0.6168, lr_0 = 9.9277e-04
Validation auc = 0.569154
Epoch 180
Validation auc = 0.566647
Epoch 181
Validation auc = 0.575805
Epoch 182
Validation auc = 0.592924
Epoch 183
Loss = 1.7917e-02, PNorm = 85.8180, GNorm = 0.2799, lr_0 = 9.9253e-04
Validation auc = 0.602791
Epoch 184
Validation auc = 0.604917
Epoch 185
Validation auc = 0.601810
Epoch 186
Validation auc = 0.609660
Epoch 187
Validation auc = 0.619555
Epoch 188
Loss = 2.5545e-02, PNorm = 85.9608, GNorm = 0.5818, lr_0 = 9.9228e-04
Loss = 1.3038e-02, PNorm = 85.9735, GNorm = 1.0676, lr_0 = 9.9226e-04
Validation auc = 0.620128
Epoch 189
Validation auc = 0.602955
Epoch 190
Validation auc = 0.628387
Epoch 191
Validation auc = 0.633811
Epoch 192
Validation auc = 0.641880
Epoch 193
Loss = 2.0495e-02, PNorm = 86.1894, GNorm = 0.7704, lr_0 = 9.9204e-04
Validation auc = 0.637382
Epoch 194
Validation auc = 0.616039
Epoch 195
Validation auc = 0.606417
Epoch 196
Validation auc = 0.603364
Epoch 197
Validation auc = 0.593442
Epoch 198
Loss = 1.8838e-02, PNorm = 86.4399, GNorm = 0.5205, lr_0 = 9.9177e-04
Validation auc = 0.567083
Epoch 199
Validation auc = 0.616829
Epoch 200
Validation auc = 0.618029
Epoch 201
Validation auc = 0.607044
Epoch 202
Loss = 4.9308e-02, PNorm = 86.6639, GNorm = 0.8529, lr_0 = 9.9154e-04
Loss = 3.5541e-04, PNorm = 86.6879, GNorm = 0.0107, lr_0 = 9.9153e-04
Validation auc = 0.608788
Epoch 203
Validation auc = 0.630758
Epoch 204
Validation auc = 0.651093
Epoch 205
Validation auc = 0.645914
Epoch 206
Validation auc = 0.658398
Epoch 207
Loss = 1.0154e-01, PNorm = 87.0352, GNorm = 1.5406, lr_0 = 9.9128e-04
Loss = 6.0694e-02, PNorm = 87.0698, GNorm = 0.9972, lr_0 = 9.9126e-04
Validation auc = 0.663414
Epoch 208
Validation auc = 0.658071
Epoch 209
Validation auc = 0.669901
Epoch 210
Validation auc = 0.671482
Epoch 211
Validation auc = 0.689582
Epoch 212
Loss = 3.2998e-02, PNorm = 87.4903, GNorm = 0.6363, lr_0 = 9.9103e-04
Validation auc = 0.713842
Epoch 213
Validation auc = 0.661124
Epoch 214
Validation auc = 0.650275
Epoch 215
Validation auc = 0.642588
Epoch 216
Loss = 6.8239e-02, PNorm = 87.9662, GNorm = 0.3535, lr_0 = 9.9079e-04
Validation auc = 0.636592
Epoch 217
Validation auc = 0.624271
Epoch 218
Validation auc = 0.617838
Epoch 219
Validation auc = 0.615766
Epoch 220
Validation auc = 0.602246
Epoch 221
Loss = 2.2337e-02, PNorm = 88.3014, GNorm = 0.1576, lr_0 = 9.9054e-04
Loss = 3.5773e-01, PNorm = 88.3271, GNorm = 5.6696, lr_0 = 9.9052e-04
Validation auc = 0.593741
Epoch 222
Validation auc = 0.583383
Epoch 223
Validation auc = 0.577168
Epoch 224
Validation auc = 0.568391
Epoch 225
Validation auc = 0.562885
Epoch 226
Loss = 3.4967e-02, PNorm = 88.6553, GNorm = 0.3647, lr_0 = 9.9030e-04
Validation auc = 0.563158
Epoch 227
Validation auc = 0.583765
Epoch 228
Validation auc = 0.600502
Epoch 229
Validation auc = 0.604481
Epoch 230
Validation auc = 0.608243
Epoch 231
Loss = 1.1820e-01, PNorm = 89.0474, GNorm = 2.3908, lr_0 = 9.9003e-04
Validation auc = 0.626370
Epoch 232
Validation auc = 0.634465
Epoch 233
Validation auc = 0.637110
Epoch 234
Validation auc = 0.637382
Epoch 235
Loss = 2.9511e-02, PNorm = 89.3810, GNorm = 0.2225, lr_0 = 9.8980e-04
Loss = 2.9484e-02, PNorm = 89.4018, GNorm = 0.8404, lr_0 = 9.8979e-04
Validation auc = 0.640653
Epoch 236
Validation auc = 0.640053
Epoch 237
Validation auc = 0.637600
Epoch 238
Validation auc = 0.634384
Epoch 239
Validation auc = 0.633103
Epoch 240
Loss = 1.5696e-02, PNorm = 89.6273, GNorm = 0.2861, lr_0 = 9.8954e-04
Loss = 6.0255e-03, PNorm = 89.6399, GNorm = 0.1762, lr_0 = 9.8952e-04
Validation auc = 0.637491
Epoch 241
Validation auc = 0.639781
Epoch 242
Validation auc = 0.642616
Epoch 243
Validation auc = 0.648149
Epoch 244
Validation auc = 0.658180
Epoch 245
Loss = 1.1414e-01, PNorm = 89.7872, GNorm = 0.3978, lr_0 = 9.8930e-04
Validation auc = 0.660034
Epoch 246
Validation auc = 0.664368
Epoch 247
Validation auc = 0.632884
Epoch 248
Validation auc = 0.618383
Epoch 249
Loss = 5.0856e-02, PNorm = 89.9597, GNorm = 3.5835, lr_0 = 9.8905e-04
Validation auc = 0.577496
Epoch 250
Validation auc = 0.583111
Epoch 251
Validation auc = 0.597176
Epoch 252
Validation auc = 0.598539
Epoch 253
Validation auc = 0.599738
Epoch 254
Loss = 3.1591e-02, PNorm = 90.2667, GNorm = 0.2349, lr_0 = 9.8880e-04
Loss = 1.6981e-02, PNorm = 90.2838, GNorm = 0.4606, lr_0 = 9.8879e-04
Validation auc = 0.606935
Epoch 255
Validation auc = 0.608025
Epoch 256
Validation auc = 0.611896
Epoch 257
Validation auc = 0.618056
Epoch 258
Validation auc = 0.610533
Epoch 259
Loss = 2.7478e-02, PNorm = 90.4834, GNorm = 0.4409, lr_0 = 9.8856e-04
Validation auc = 0.586273
Epoch 260
Validation auc = 0.576514
Epoch 261
Validation auc = 0.575805
Epoch 262
Validation auc = 0.579513
Epoch 263
Validation auc = 0.587527
Epoch 264
Loss = 1.1379e-02, PNorm = 90.7361, GNorm = 0.3468, lr_0 = 9.8830e-04
Validation auc = 0.593741
Epoch 265
Validation auc = 0.597285
Epoch 266
Validation auc = 0.596413
Epoch 267
Validation auc = 0.595759
Epoch 268
Loss = 1.2889e-02, PNorm = 90.8938, GNorm = 0.0750, lr_0 = 9.8807e-04
Loss = 2.9734e-02, PNorm = 90.9039, GNorm = 0.6617, lr_0 = 9.8805e-04
Validation auc = 0.595922
Epoch 269
Validation auc = 0.596195
Epoch 270
Validation auc = 0.596413
Epoch 271
Validation auc = 0.593905
Epoch 272
Validation auc = 0.592597
Epoch 273
Loss = 8.2138e-02, PNorm = 91.0108, GNorm = 0.9286, lr_0 = 9.8781e-04
Loss = 3.3168e-03, PNorm = 91.0149, GNorm = 0.0916, lr_0 = 9.8779e-04
Validation auc = 0.596413
Epoch 274
Validation auc = 0.599738
Epoch 275
Validation auc = 0.601265
Epoch 276
Validation auc = 0.590907
Epoch 277
Validation auc = 0.564084
Epoch 278
Loss = 8.3891e-02, PNorm = 91.1065, GNorm = 1.0061, lr_0 = 9.8756e-04
Validation auc = 0.570681
Epoch 279
Validation auc = 0.576296
Epoch 280
Validation auc = 0.566102
Epoch 281
Validation auc = 0.577386
Epoch 282
Validation auc = 0.558088
Epoch 283
Loss = 2.6223e-02, PNorm = 91.4103, GNorm = 0.5075, lr_0 = 9.8730e-04
Validation auc = 0.602301
Epoch 284
Validation auc = 0.606716
Epoch 285
Validation auc = 0.584201
Epoch 286
Validation auc = 0.574115
Epoch 287
Loss = 5.1224e-02, PNorm = 92.2339, GNorm = 0.4685, lr_0 = 9.8707e-04
Loss = 8.5695e-02, PNorm = 92.3024, GNorm = 1.8695, lr_0 = 9.8705e-04
Validation auc = 0.583983
Epoch 288
Validation auc = 0.605190
Epoch 289
Validation auc = 0.630377
Epoch 290
Validation auc = 0.621763
Epoch 291
Validation auc = 0.611787
Epoch 292
Loss = 9.3862e-02, PNorm = 92.9816, GNorm = 1.8879, lr_0 = 9.8683e-04
Validation auc = 0.605081
Epoch 293
Validation auc = 0.600065
Epoch 294
Validation auc = 0.594832
Epoch 295
Validation auc = 0.595377
Epoch 296
Validation auc = 0.600120
Epoch 297
Loss = 3.5603e-02, PNorm = 93.4777, GNorm = 0.2784, lr_0 = 9.8656e-04
Validation auc = 0.604863
Epoch 298
Validation auc = 0.606662
Epoch 299
Validation auc = 0.599302
Epoch 300
Validation auc = 0.586763
Epoch 301
Loss = 1.7340e-02, PNorm = 93.7246, GNorm = 0.3189, lr_0 = 9.8634e-04
Loss = 2.4896e-03, PNorm = 93.7393, GNorm = 0.1524, lr_0 = 9.8632e-04
Validation auc = 0.577550
Epoch 302
Validation auc = 0.592924
Epoch 303
Validation auc = 0.598212
Epoch 304
Validation auc = 0.600883
Epoch 305
Validation auc = 0.600338
Epoch 306
Loss = 6.2702e-03, PNorm = 93.9205, GNorm = 0.1202, lr_0 = 9.8607e-04
Loss = 9.8663e-03, PNorm = 93.9303, GNorm = 0.2988, lr_0 = 9.8606e-04
Validation auc = 0.594232
Epoch 307
Validation auc = 0.589762
Epoch 308
Validation auc = 0.587581
Epoch 309
Validation auc = 0.590198
Epoch 310
Validation auc = 0.593796
Epoch 311
Loss = 1.4424e-02, PNorm = 94.0477, GNorm = 0.4699, lr_0 = 9.8583e-04
Validation auc = 0.588017
Epoch 312
Validation auc = 0.583928
Epoch 313
Validation auc = 0.580548
Epoch 314
Validation auc = 0.583710
Epoch 315
Validation auc = 0.584474
Epoch 316
Loss = 7.7094e-02, PNorm = 94.1757, GNorm = 1.6796, lr_0 = 9.8557e-04
Validation auc = 0.592324
Epoch 317
Validation auc = 0.596522
Epoch 318
Validation auc = 0.606171
Epoch 319
Validation auc = 0.617184
Epoch 320
Loss = 1.7278e-03, PNorm = 94.2917, GNorm = 0.0713, lr_0 = 9.8534e-04
Loss = 4.7136e-04, PNorm = 94.3047, GNorm = 0.0116, lr_0 = 9.8532e-04
Validation auc = 0.632012
Epoch 321
Validation auc = 0.641280
Epoch 322
Validation auc = 0.631685
Epoch 323
Validation auc = 0.623998
Epoch 324
Validation auc = 0.625579
Epoch 325
Loss = 1.4231e-02, PNorm = 94.4652, GNorm = 0.2504, lr_0 = 9.8509e-04
Validation auc = 0.621054
Epoch 326
Validation auc = 0.638227
Epoch 327
Validation auc = 0.626179
Epoch 328
Validation auc = 0.545031
Epoch 329
Validation auc = 0.566810
Epoch 330
Loss = 2.3187e-01, PNorm = 95.0277, GNorm = 1.4950, lr_0 = 9.8483e-04
Validation auc = 0.583002
Epoch 331
Validation auc = 0.583656
Epoch 332
Validation auc = 0.591506
Epoch 333
Validation auc = 0.588235
Epoch 334
Loss = 5.0325e-02, PNorm = 96.0606, GNorm = 0.6177, lr_0 = 9.8461e-04
Loss = 1.3696e-02, PNorm = 96.1209, GNorm = 0.2928, lr_0 = 9.8459e-04
Validation auc = 0.598921
Epoch 335
Validation auc = 0.600556
Epoch 336
Validation auc = 0.589980
Epoch 337
Validation auc = 0.602791
Epoch 338
Validation auc = 0.612550
Epoch 339
Loss = 2.2259e-01, PNorm = 96.7505, GNorm = 1.9704, lr_0 = 9.8434e-04
Loss = 1.8872e-01, PNorm = 96.7913, GNorm = 5.8673, lr_0 = 9.8433e-04
Validation auc = 0.610587
Epoch 340
Validation auc = 0.633757
Epoch 341
Validation auc = 0.633975
Epoch 342
Validation auc = 0.596903
Epoch 343
Validation auc = 0.639972
Epoch 344
Loss = 7.2522e-02, PNorm = 97.3371, GNorm = 0.7610, lr_0 = 9.8410e-04
Validation auc = 0.663577
Epoch 345
Validation auc = 0.665213
Epoch 346
Validation auc = 0.673281
Epoch 347
Validation auc = 0.677316
Epoch 348
Validation auc = 0.680641
Epoch 349
Loss = 3.1002e-02, PNorm = 97.7944, GNorm = 0.4231, lr_0 = 9.8384e-04
Validation auc = 0.673663
Epoch 350
Validation auc = 0.662869
Epoch 351
Validation auc = 0.657253
Epoch 352
Validation auc = 0.656218
Epoch 353
Loss = 9.4799e-02, PNorm = 98.0391, GNorm = 0.3973, lr_0 = 9.8361e-04
Loss = 6.5621e-03, PNorm = 98.0556, GNorm = 0.1454, lr_0 = 9.8359e-04
Validation auc = 0.660415
Epoch 354
Validation auc = 0.664068
Epoch 355
Validation auc = 0.668756
Epoch 356
Validation auc = 0.675408
Epoch 357
Validation auc = 0.668429
Epoch 358
Loss = 3.3423e-02, PNorm = 98.2280, GNorm = 0.0408, lr_0 = 9.8335e-04
Validation auc = 0.667721
Epoch 359
Validation auc = 0.666685
Epoch 360
Validation auc = 0.667993
Epoch 361
Validation auc = 0.668811
Epoch 362
Validation auc = 0.669084
Epoch 363
Loss = 8.4039e-03, PNorm = 98.3226, GNorm = 0.1158, lr_0 = 9.8311e-04
Validation auc = 0.667884
Epoch 364
Validation auc = 0.667830
Epoch 365
Validation auc = 0.675353
Epoch 366
Validation auc = 0.660743
Epoch 367
Loss = 3.2058e-02, PNorm = 98.4086, GNorm = 0.1506, lr_0 = 9.8288e-04
Loss = 2.9618e-02, PNorm = 98.4350, GNorm = 1.6453, lr_0 = 9.8286e-04
Validation auc = 0.676716
Epoch 368
Validation auc = 0.677970
Epoch 369
Validation auc = 0.675380
Epoch 370
Validation auc = 0.700594
Epoch 371
Validation auc = 0.689146
Epoch 372
Loss = 2.0155e-01, PNorm = 99.2589, GNorm = 0.7083, lr_0 = 9.8262e-04
Loss = 4.0847e-02, PNorm = 99.3318, GNorm = 0.7270, lr_0 = 9.8260e-04
Validation auc = 0.652347
Epoch 373
Validation auc = 0.616857
Epoch 374
Validation auc = 0.582347
Epoch 375
Validation auc = 0.581366
Epoch 376
Validation auc = 0.563648
Epoch 377
Loss = 7.1954e-02, PNorm = 100.0215, GNorm = 0.8332, lr_0 = 9.8237e-04
Validation auc = 0.621490
Epoch 378
Validation auc = 0.675244
Epoch 379
Validation auc = 0.684621
Epoch 380
Validation auc = 0.682386
Epoch 381
Validation auc = 0.679278
Epoch 382
Loss = 1.3905e-01, PNorm = 100.4447, GNorm = 1.4218, lr_0 = 9.8211e-04
Validation auc = 0.678515
Epoch 383
Validation auc = 0.678788
Epoch 384
Validation auc = 0.673227
Epoch 385
Validation auc = 0.665540
Epoch 386
Loss = 3.6291e-02, PNorm = 100.6762, GNorm = 0.1789, lr_0 = 9.8189e-04
Loss = 1.1895e+00, PNorm = 100.6894, GNorm = 5.5748, lr_0 = 9.8187e-04
Validation auc = 0.671973
Epoch 387
Validation auc = 0.683803
Epoch 388
Validation auc = 0.671155
Epoch 389
Validation auc = 0.653110
Epoch 390
Validation auc = 0.637627
Epoch 391
Loss = 1.0332e-01, PNorm = 100.9754, GNorm = 1.3777, lr_0 = 9.8163e-04
Validation auc = 0.629014
Epoch 392
Validation auc = 0.638663
Epoch 393
Validation auc = 0.643624
Epoch 394
Validation auc = 0.646514
Epoch 395
Validation auc = 0.645478
Epoch 396
Loss = 2.9827e-02, PNorm = 101.2195, GNorm = 0.4530, lr_0 = 9.8138e-04
Validation auc = 0.643079
Epoch 397
Validation auc = 0.642970
Epoch 398
Validation auc = 0.642588
Epoch 399
Validation auc = 0.642588
Epoch 400
Loss = 1.0226e-02, PNorm = 101.3571, GNorm = 0.1233, lr_0 = 9.8116e-04
Loss = 1.2355e-02, PNorm = 101.3645, GNorm = 0.2488, lr_0 = 9.8114e-04
Validation auc = 0.641171
Epoch 401
Validation auc = 0.640680
Epoch 402
Validation auc = 0.644878
Epoch 403
Validation auc = 0.648476
Epoch 404
Validation auc = 0.651747
Epoch 405
Loss = 3.2024e-03, PNorm = 101.4416, GNorm = 0.0511, lr_0 = 9.8089e-04
Loss = 2.6487e-03, PNorm = 101.4456, GNorm = 0.0831, lr_0 = 9.8088e-04
Validation auc = 0.654091
Epoch 406
Validation auc = 0.655400
Epoch 407
Validation auc = 0.656708
Epoch 408
Validation auc = 0.652838
Epoch 409
Validation auc = 0.648858
Epoch 410
Loss = 4.3076e-03, PNorm = 101.4945, GNorm = 0.0928, lr_0 = 9.8065e-04
Validation auc = 0.647931
Epoch 411
Validation auc = 0.647277
Epoch 412
Validation auc = 0.646568
Epoch 413
Validation auc = 0.644333
Epoch 414
Validation auc = 0.643025
Epoch 415
Loss = 1.2513e-02, PNorm = 101.5467, GNorm = 0.3324, lr_0 = 9.8039e-04
Validation auc = 0.642861
Epoch 416
Validation auc = 0.640571
Epoch 417
Validation auc = 0.639099
Epoch 418
Validation auc = 0.637464
Epoch 419
Loss = 7.2924e-02, PNorm = 101.5971, GNorm = 0.9695, lr_0 = 9.8016e-04
Loss = 3.3273e-03, PNorm = 101.6003, GNorm = 0.1069, lr_0 = 9.8015e-04
Validation auc = 0.637736
Epoch 420
Validation auc = 0.640299
Epoch 421
Validation auc = 0.642861
Epoch 422
Validation auc = 0.643352
Epoch 423
Validation auc = 0.644115
Epoch 424
Loss = 3.7002e-03, PNorm = 101.6543, GNorm = 0.0705, lr_0 = 9.7990e-04
Validation auc = 0.644606
Epoch 425
Validation auc = 0.645096
Epoch 426
Validation auc = 0.645750
Epoch 427
Validation auc = 0.646841
Epoch 428
Validation auc = 0.648204
Epoch 429
Loss = 1.5252e-03, PNorm = 101.6906, GNorm = 0.0242, lr_0 = 9.7966e-04
Validation auc = 0.648803
Epoch 430
Validation auc = 0.647495
Epoch 431
Validation auc = 0.647222
Epoch 432
Validation auc = 0.647113
Epoch 433
Loss = 1.3923e-03, PNorm = 101.7270, GNorm = 0.0368, lr_0 = 9.7942e-04
Validation auc = 0.647004
Epoch 434
Validation auc = 0.647495
Epoch 435
Validation auc = 0.648858
Epoch 436
Validation auc = 0.647659
Epoch 437
Validation auc = 0.648912
Epoch 438
Loss = 2.8526e-03, PNorm = 101.7669, GNorm = 0.0772, lr_0 = 9.7917e-04
Loss = 1.4272e-03, PNorm = 101.7723, GNorm = 0.0374, lr_0 = 9.7916e-04
Validation auc = 0.652347
Epoch 439
Validation auc = 0.653383
Epoch 440
Validation auc = 0.656926
Epoch 441
Validation auc = 0.658344
Epoch 442
Validation auc = 0.659434
Epoch 443
Loss = 1.8994e-03, PNorm = 101.8365, GNorm = 0.0436, lr_0 = 9.7893e-04
Validation auc = 0.660688
Epoch 444
Validation auc = 0.658616
Epoch 445
Validation auc = 0.657144
Epoch 446
Validation auc = 0.654746
Epoch 447
Validation auc = 0.652783
Epoch 448
Loss = 9.3296e-04, PNorm = 101.8754, GNorm = 0.0142, lr_0 = 9.7867e-04
Validation auc = 0.651856
Epoch 449
Validation auc = 0.649839
Epoch 450
Validation auc = 0.649676
Epoch 451
Validation auc = 0.649621
Epoch 452
Loss = 2.3928e-03, PNorm = 101.8951, GNorm = 0.0860, lr_0 = 9.7845e-04
Loss = 2.0632e-04, PNorm = 101.8965, GNorm = 0.0120, lr_0 = 9.7843e-04
Validation auc = 0.650166
Epoch 453
Validation auc = 0.647604
Epoch 454
Validation auc = 0.648149
Epoch 455
Validation auc = 0.648531
Epoch 456
Validation auc = 0.647877
Epoch 457
Loss = 1.7244e-02, PNorm = 101.9304, GNorm = 0.2689, lr_0 = 9.7819e-04
Loss = 4.8171e-03, PNorm = 101.9357, GNorm = 0.1564, lr_0 = 9.7817e-04
Validation auc = 0.656817
Epoch 458
Validation auc = 0.664450
Epoch 459
Validation auc = 0.669138
Epoch 460
Validation auc = 0.673772
Epoch 461
Validation auc = 0.677261
Epoch 462
Loss = 1.4809e-03, PNorm = 101.9931, GNorm = 0.0292, lr_0 = 9.7794e-04
Validation auc = 0.675571
Epoch 463
Validation auc = 0.670992
Epoch 464
Validation auc = 0.669138
Epoch 465
Validation auc = 0.667666
Epoch 466
Loss = 1.4048e-03, PNorm = 102.0273, GNorm = 0.0376, lr_0 = 9.7770e-04
Validation auc = 0.666576
Epoch 467
Validation auc = 0.665867
Epoch 468
Validation auc = 0.664559
Epoch 469
Validation auc = 0.663414
Epoch 470
Validation auc = 0.661833
Epoch 471
Loss = 3.2142e-02, PNorm = 102.0508, GNorm = 0.6329, lr_0 = 9.7746e-04
Loss = 6.1475e-03, PNorm = 102.0525, GNorm = 0.3407, lr_0 = 9.7744e-04
Validation auc = 0.661179
Epoch 472
Validation auc = 0.659598
Epoch 473
Validation auc = 0.659598
Epoch 474
Validation auc = 0.659325
Epoch 475
Validation auc = 0.661996
Epoch 476
Loss = 1.4358e-03, PNorm = 102.0777, GNorm = 0.0250, lr_0 = 9.7721e-04
Validation auc = 0.661179
Epoch 477
Validation auc = 0.657035
Epoch 478
Validation auc = 0.654909
Epoch 479
Validation auc = 0.653056
Epoch 480
Validation auc = 0.651911
Epoch 481
Loss = 1.1370e-03, PNorm = 102.1349, GNorm = 0.0223, lr_0 = 9.7695e-04
Validation auc = 0.649130
Epoch 482
Validation auc = 0.646786
Epoch 483
Validation auc = 0.645914
Epoch 484
Validation auc = 0.647713
Epoch 485
Loss = 4.1438e-03, PNorm = 102.1704, GNorm = 0.1142, lr_0 = 9.7673e-04
Loss = 1.3949e-04, PNorm = 102.1729, GNorm = 0.0056, lr_0 = 9.7671e-04
Validation auc = 0.647713
Epoch 486
Validation auc = 0.648476
Epoch 487
Validation auc = 0.647659
Epoch 488
Validation auc = 0.649349
Epoch 489
Validation auc = 0.649021
Epoch 490
Loss = 1.6617e-03, PNorm = 102.2033, GNorm = 0.0150, lr_0 = 9.7647e-04
Loss = 1.7077e-03, PNorm = 102.2066, GNorm = 0.0508, lr_0 = 9.7645e-04
Validation auc = 0.650221
Epoch 491
Validation auc = 0.650384
Epoch 492
Validation auc = 0.650875
Epoch 493
Validation auc = 0.652129
Epoch 494
Validation auc = 0.654528
Epoch 495
Loss = 2.4772e-03, PNorm = 102.2370, GNorm = 0.0442, lr_0 = 9.7623e-04
Validation auc = 0.654201
Epoch 496
Validation auc = 0.654419
Epoch 497
Validation auc = 0.658071
Epoch 498
Validation auc = 0.654746
Epoch 499
Loss = 2.2854e-03, PNorm = 102.2832, GNorm = 0.0146, lr_0 = 9.7599e-04
Validation auc = 0.649349
Epoch 500
Validation auc = 0.646405
Epoch 501
Validation auc = 0.644169
Epoch 502
Validation auc = 0.645641
Epoch 503
Validation auc = 0.642807
Epoch 504
Loss = 4.4183e-04, PNorm = 102.3221, GNorm = 0.0120, lr_0 = 9.7574e-04
Loss = 6.7431e-04, PNorm = 102.3239, GNorm = 0.0215, lr_0 = 9.7573e-04
Validation auc = 0.641444
Epoch 505
Validation auc = 0.636265
Epoch 506
Validation auc = 0.631467
Epoch 507
Validation auc = 0.628632
Epoch 508
Validation auc = 0.629395
Epoch 509
Loss = 1.2831e-03, PNorm = 102.3531, GNorm = 0.0199, lr_0 = 9.7550e-04
Validation auc = 0.630104
Epoch 510
Validation auc = 0.624652
Epoch 511
Validation auc = 0.627215
Epoch 512
Validation auc = 0.646132
Epoch 513
Validation auc = 0.655618
Epoch 514
Loss = 4.3569e-02, PNorm = 102.5106, GNorm = 0.8399, lr_0 = 9.7524e-04
Validation auc = 0.655345
Epoch 515
Validation auc = 0.644715
Epoch 516
Validation auc = 0.638936
Epoch 517
Validation auc = 0.633375
Epoch 518
Loss = 4.9097e-03, PNorm = 102.6845, GNorm = 0.1532, lr_0 = 9.7502e-04
Loss = 3.0553e-03, PNorm = 102.6929, GNorm = 0.1158, lr_0 = 9.7500e-04
Validation auc = 0.629886
Epoch 519
Validation auc = 0.631358
Epoch 520
Validation auc = 0.633648
Epoch 521
Validation auc = 0.636046
Epoch 522
Validation auc = 0.637355
Epoch 523
Loss = 1.0903e-03, PNorm = 102.7772, GNorm = 0.0187, lr_0 = 9.7476e-04
Loss = 5.7098e-04, PNorm = 102.7830, GNorm = 0.0233, lr_0 = 9.7474e-04
Validation auc = 0.636319
Epoch 524
Validation auc = 0.635610
Epoch 525
Validation auc = 0.634574
Epoch 526
Validation auc = 0.634902
Epoch 527
Validation auc = 0.634574
Epoch 528
Loss = 4.0850e-03, PNorm = 102.8606, GNorm = 0.0994, lr_0 = 9.7452e-04
Validation auc = 0.613177
Epoch 529
Validation auc = 0.625470
Epoch 530
Validation auc = 0.650112
Epoch 531
Validation auc = 0.648367
Epoch 532
Validation auc = 0.638881
Epoch 533
Loss = 2.3820e-01, PNorm = 103.2260, GNorm = 2.5851, lr_0 = 9.7426e-04
Validation auc = 0.617565
Epoch 534
Validation auc = 0.611514
Epoch 535
Validation auc = 0.617456
Epoch 536
Validation auc = 0.613586
Epoch 537
Loss = 6.2926e-02, PNorm = 103.5032, GNorm = 1.0959, lr_0 = 9.7403e-04
Loss = 1.3013e-02, PNorm = 103.5201, GNorm = 0.9277, lr_0 = 9.7401e-04
Validation auc = 0.618110
Epoch 538
Validation auc = 0.625143
Epoch 539
Validation auc = 0.631249
Epoch 540
Validation auc = 0.639263
Epoch 541
Validation auc = 0.645532
Epoch 542
Loss = 4.6005e-02, PNorm = 103.6865, GNorm = 0.4509, lr_0 = 9.7379e-04
Validation auc = 0.646732
Epoch 543
Validation auc = 0.649730
Epoch 544
Validation auc = 0.650166
Epoch 545
Validation auc = 0.651202
Epoch 546
Validation auc = 0.651420
Epoch 547
Loss = 8.4354e-03, PNorm = 103.7845, GNorm = 0.1573, lr_0 = 9.7353e-04
Validation auc = 0.650384
Epoch 548
Validation auc = 0.649185
Epoch 549
Validation auc = 0.648095
Epoch 550
Validation auc = 0.643788
Epoch 551
Loss = 1.5053e-02, PNorm = 103.8532, GNorm = 0.5678, lr_0 = 9.7331e-04
Loss = 1.8772e-03, PNorm = 103.8595, GNorm = 0.0405, lr_0 = 9.7329e-04
Validation auc = 0.642861
Epoch 552
Validation auc = 0.644169
Epoch 553
Validation auc = 0.643842
Epoch 554
Validation auc = 0.644224
Epoch 555
Validation auc = 0.644715
Epoch 556
Loss = 3.0522e-03, PNorm = 103.9290, GNorm = 0.0355, lr_0 = 9.7305e-04
Loss = 4.8485e-04, PNorm = 103.9327, GNorm = 0.0141, lr_0 = 9.7303e-04
Validation auc = 0.644551
Epoch 557
Validation auc = 0.643243
Epoch 558
Validation auc = 0.642916
Epoch 559
Validation auc = 0.646459
Epoch 560
Validation auc = 0.650439
Epoch 561
Loss = 5.8460e-03, PNorm = 103.9684, GNorm = 0.2176, lr_0 = 9.7281e-04
Validation auc = 0.654473
Epoch 562
Validation auc = 0.659325
Epoch 563
Validation auc = 0.666303
Epoch 564
Validation auc = 0.668266
Epoch 565
Validation auc = 0.667775
Epoch 566
Loss = 3.4928e-03, PNorm = 104.0052, GNorm = 0.0503, lr_0 = 9.7255e-04
Validation auc = 0.666630
Epoch 567
Validation auc = 0.667230
Epoch 568
Validation auc = 0.666467
Epoch 569
Validation auc = 0.665922
Epoch 570
Loss = 2.7310e-03, PNorm = 104.0334, GNorm = 0.1399, lr_0 = 9.7232e-04
Loss = 2.4205e-04, PNorm = 104.0350, GNorm = 0.0072, lr_0 = 9.7231e-04
Validation auc = 0.663577
Epoch 571
Validation auc = 0.662051
Epoch 572
Validation auc = 0.661233
Epoch 573
Validation auc = 0.664014
Epoch 574
Validation auc = 0.666630
Epoch 575
Loss = 1.5092e-03, PNorm = 104.0485, GNorm = 0.0283, lr_0 = 9.7208e-04
Validation auc = 0.665158
Epoch 576
Validation auc = 0.662487
Epoch 577
Validation auc = 0.659162
Epoch 578
Validation auc = 0.656763
Epoch 579
Validation auc = 0.653710
Epoch 580
Loss = 1.1866e-03, PNorm = 104.0692, GNorm = 0.0188, lr_0 = 9.7182e-04
Validation auc = 0.651093
Epoch 581
Validation auc = 0.648803
Epoch 582
Validation auc = 0.647222
Epoch 583
Validation auc = 0.646078
Epoch 584
Loss = 2.2615e-02, PNorm = 104.0848, GNorm = 0.9131, lr_0 = 9.7160e-04
Loss = 6.4822e-04, PNorm = 104.0873, GNorm = 0.0250, lr_0 = 9.7158e-04
Validation auc = 0.646241
Epoch 585
Validation auc = 0.648640
Epoch 586
Validation auc = 0.650493
Epoch 587
Validation auc = 0.651311
Epoch 588
Validation auc = 0.651366
Epoch 589
Loss = 5.9997e-04, PNorm = 104.1197, GNorm = 0.0072, lr_0 = 9.7134e-04
Loss = 3.7336e-03, PNorm = 104.1213, GNorm = 0.0769, lr_0 = 9.7132e-04
Validation auc = 0.651420
Epoch 590
Validation auc = 0.651202
Epoch 591
Validation auc = 0.650275
Epoch 592
Validation auc = 0.650112
Epoch 593
Validation auc = 0.649512
Epoch 594
Loss = 7.9465e-04, PNorm = 104.1419, GNorm = 0.0140, lr_0 = 9.7110e-04
Validation auc = 0.649458
Epoch 595
Validation auc = 0.651856
Epoch 596
Validation auc = 0.658017
Epoch 597
Validation auc = 0.661669
Epoch 598
Validation auc = 0.665704
Epoch 599
Loss = 5.1716e-03, PNorm = 104.1879, GNorm = 0.1375, lr_0 = 9.7084e-04
Validation auc = 0.671428
Epoch 600
Validation auc = 0.672355
Epoch 601
Validation auc = 0.674699
Epoch 602
Validation auc = 0.673336
Epoch 603
Loss = 3.2399e-03, PNorm = 104.2511, GNorm = 0.0156, lr_0 = 9.7062e-04
Loss = 9.1365e-04, PNorm = 104.2552, GNorm = 0.0300, lr_0 = 9.7060e-04
Validation auc = 0.673936
Epoch 604
Validation auc = 0.673227
Epoch 605
Validation auc = 0.673663
Epoch 606
Validation auc = 0.669138
Epoch 607
Validation auc = 0.670556
Epoch 608
Loss = 2.0038e-03, PNorm = 104.3035, GNorm = 0.0155, lr_0 = 9.7036e-04
Validation auc = 0.671646
Epoch 609
Validation auc = 0.671646
Epoch 610
Validation auc = 0.672409
Epoch 611
Validation auc = 0.671864
Epoch 612
Validation auc = 0.670501
Epoch 613
Loss = 2.2873e-03, PNorm = 104.3441, GNorm = 0.0430, lr_0 = 9.7012e-04
Validation auc = 0.668320
Epoch 614
Validation auc = 0.666412
Epoch 615
Validation auc = 0.665158
Epoch 616
Validation auc = 0.663577
Epoch 617
Loss = 6.4238e-03, PNorm = 104.3713, GNorm = 0.4922, lr_0 = 9.6990e-04
Loss = 1.3504e-03, PNorm = 104.3729, GNorm = 0.0651, lr_0 = 9.6988e-04
Validation auc = 0.662433
Epoch 618
Validation auc = 0.661179
Epoch 619
Validation auc = 0.660361
Epoch 620
Validation auc = 0.657635
Epoch 621
Validation auc = 0.654746
Epoch 622
Loss = 1.5360e-03, PNorm = 104.3917, GNorm = 0.0998, lr_0 = 9.6964e-04
Loss = 1.4846e-02, PNorm = 104.3930, GNorm = 0.2239, lr_0 = 9.6962e-04
Validation auc = 0.652674
Epoch 623
Validation auc = 0.651148
Epoch 624
Validation auc = 0.649294
Epoch 625
Validation auc = 0.649621
Epoch 626
Validation auc = 0.650766
Epoch 627
Loss = 1.3419e-01, PNorm = 104.4139, GNorm = 1.1954, lr_0 = 9.6940e-04
Validation auc = 0.655727
Epoch 628
Validation auc = 0.649130
Epoch 629
Validation auc = 0.644987
Epoch 630
Validation auc = 0.646459
Epoch 631
Validation auc = 0.646350
Epoch 632
Loss = 6.9872e-03, PNorm = 104.4619, GNorm = 0.2026, lr_0 = 9.6914e-04
Validation auc = 0.647004
Epoch 633
Validation auc = 0.643134
Epoch 634
Validation auc = 0.641498
Epoch 635
Validation auc = 0.641007
Epoch 636
Loss = 1.9191e-02, PNorm = 104.4960, GNorm = 0.7544, lr_0 = 9.6892e-04
Loss = 1.1713e-03, PNorm = 104.4990, GNorm = 0.0705, lr_0 = 9.6890e-04
Validation auc = 0.641171
Epoch 637
Validation auc = 0.641117
Epoch 638
Validation auc = 0.641880
Epoch 639
Validation auc = 0.641444
Epoch 640
Validation auc = 0.640081
Epoch 641
Loss = 6.8768e-02, PNorm = 104.5432, GNorm = 0.0211, lr_0 = 9.6866e-04
Validation auc = 0.631413
Epoch 642
Validation auc = 0.622962
Epoch 643
Validation auc = 0.616311
Epoch 644
Validation auc = 0.613586
Epoch 645
Validation auc = 0.615276
Epoch 646
Loss = 5.5662e-02, PNorm = 104.6238, GNorm = 0.5342, lr_0 = 9.6842e-04
Validation auc = 0.618110
Epoch 647
Validation auc = 0.620509
Epoch 648
Validation auc = 0.621709
Epoch 649
Validation auc = 0.623181
Epoch 650
Loss = 1.8779e-03, PNorm = 104.6937, GNorm = 0.0346, lr_0 = 9.6820e-04
Loss = 1.3596e-04, PNorm = 104.6972, GNorm = 0.0045, lr_0 = 9.6818e-04
Validation auc = 0.624053
Epoch 651
Validation auc = 0.624107
Epoch 652
Validation auc = 0.622363
Epoch 653
Validation auc = 0.620945
Epoch 654
Validation auc = 0.619528
Epoch 655
Loss = 9.6108e-04, PNorm = 104.7295, GNorm = 0.0257, lr_0 = 9.6794e-04
Loss = 1.6116e-04, PNorm = 104.7310, GNorm = 0.0057, lr_0 = 9.6792e-04
Validation auc = 0.619092
Epoch 656
Validation auc = 0.618928
Epoch 657
Validation auc = 0.616311
Epoch 658
Validation auc = 0.613695
Epoch 659
Validation auc = 0.612059
Epoch 660
Loss = 2.7170e-04, PNorm = 104.7462, GNorm = 0.0054, lr_0 = 9.6770e-04
Validation auc = 0.611241
Epoch 661
Validation auc = 0.610587
Epoch 662
Validation auc = 0.610151
Epoch 663
Validation auc = 0.608352
Epoch 664
Validation auc = 0.606716
Epoch 665
Loss = 1.2427e-01, PNorm = 104.7556, GNorm = 0.7131, lr_0 = 9.6744e-04
Validation auc = 0.605081
Epoch 666
Validation auc = 0.603554
Epoch 667
Validation auc = 0.600883
Epoch 668
Validation auc = 0.599248
Epoch 669
Loss = 5.3098e-03, PNorm = 104.7677, GNorm = 0.0405, lr_0 = 9.6722e-04
Loss = 6.8729e-04, PNorm = 104.7700, GNorm = 0.0222, lr_0 = 9.6720e-04
Validation auc = 0.598484
Epoch 670
Validation auc = 0.599520
Epoch 671
Validation auc = 0.600774
Epoch 672
Validation auc = 0.601864
Epoch 673
Validation auc = 0.602519
Epoch 674
Loss = 2.1112e-04, PNorm = 104.7978, GNorm = 0.0048, lr_0 = 9.6696e-04
Validation auc = 0.603282
Epoch 675
Validation auc = 0.603173
Epoch 676
Validation auc = 0.603064
Epoch 677
Validation auc = 0.599248
Epoch 678
Validation auc = 0.598321
Epoch 679
Loss = 1.4272e-03, PNorm = 104.8102, GNorm = 0.0188, lr_0 = 9.6672e-04
Validation auc = 0.598157
Epoch 680
Validation auc = 0.598812
Epoch 681
Validation auc = 0.602083
Epoch 682
Validation auc = 0.601783
Epoch 683
Loss = 8.2364e-03, PNorm = 104.8289, GNorm = 0.6456, lr_0 = 9.6648e-04
Validation auc = 0.603554
Epoch 684
Validation auc = 0.603991
Epoch 685
Validation auc = 0.603773
Epoch 686
Validation auc = 0.604481
Epoch 687
Validation auc = 0.604427
Epoch 688
Loss = 4.2124e-03, PNorm = 104.8719, GNorm = 0.0187, lr_0 = 9.6624e-04
Loss = 1.0514e-03, PNorm = 104.8739, GNorm = 0.0256, lr_0 = 9.6622e-04
Validation auc = 0.604154
Epoch 689
Validation auc = 0.604645
Epoch 690
Validation auc = 0.604372
Epoch 691
Validation auc = 0.605299
Epoch 692
Validation auc = 0.606062
Epoch 693
Loss = 9.5285e-04, PNorm = 104.8907, GNorm = 0.0125, lr_0 = 9.6600e-04
Validation auc = 0.606117
Epoch 694
Validation auc = 0.606280
Epoch 695
Validation auc = 0.605844
Epoch 696
Validation auc = 0.605245
Epoch 697
Validation auc = 0.601374
Epoch 698
Loss = 6.8426e-04, PNorm = 104.9010, GNorm = 0.0141, lr_0 = 9.6574e-04
Validation auc = 0.598648
Epoch 699
Validation auc = 0.597231
Epoch 700
Validation auc = 0.545767
Epoch 701
Validation auc = 0.601265
Epoch 702
Loss = 1.4662e-03, PNorm = 104.9090, GNorm = 0.0187, lr_0 = 9.6552e-04
Loss = 3.1607e-04, PNorm = 104.9117, GNorm = 0.0121, lr_0 = 9.6550e-04
Validation auc = 0.619855
Epoch 703
Validation auc = 0.627106
Epoch 704
Validation auc = 0.631413
Epoch 705
Validation auc = 0.633048
Epoch 706
Validation auc = 0.636592
Epoch 707
Loss = 7.4414e-04, PNorm = 104.9464, GNorm = 0.0267, lr_0 = 9.6526e-04
Loss = 5.3143e-05, PNorm = 104.9481, GNorm = 0.0015, lr_0 = 9.6525e-04
Validation auc = 0.637682
Epoch 708
Validation auc = 0.639099
Epoch 709
Validation auc = 0.638936
Epoch 710
Validation auc = 0.638445
Epoch 711
Validation auc = 0.638500
Epoch 712
Loss = 3.8558e-03, PNorm = 104.9678, GNorm = 0.0586, lr_0 = 9.6502e-04
Validation auc = 0.637900
Epoch 713
Validation auc = 0.637246
Epoch 714
Validation auc = 0.636537
Epoch 715
Validation auc = 0.630922
Epoch 716
Loss = 9.9277e-04, PNorm = 104.9871, GNorm = 0.0130, lr_0 = 9.6479e-04
Validation auc = 0.623399
Epoch 717
Validation auc = 0.618329
Epoch 718
Validation auc = 0.615058
Epoch 719
Validation auc = 0.613586
Epoch 720
Validation auc = 0.613531
Epoch 721
Loss = 1.4647e-03, PNorm = 105.0066, GNorm = 0.0344, lr_0 = 9.6455e-04
Loss = 9.2635e-04, PNorm = 105.0077, GNorm = 0.0272, lr_0 = 9.6453e-04
Validation auc = 0.614403
Epoch 722
Validation auc = 0.614676
Epoch 723
Validation auc = 0.614076
Epoch 724
Validation auc = 0.613804
Epoch 725
Validation auc = 0.603500
Epoch 726
Loss = 3.0360e-03, PNorm = 105.0259, GNorm = 0.0827, lr_0 = 9.6431e-04
Validation auc = 0.592270
Epoch 727
Validation auc = 0.586327
Epoch 728
Validation auc = 0.583656
Epoch 729
Validation auc = 0.589162
Epoch 730
Validation auc = 0.599357
Epoch 731
Loss = 1.1954e-03, PNorm = 105.0542, GNorm = 0.0324, lr_0 = 9.6405e-04
Validation auc = 0.608406
Epoch 732
Validation auc = 0.615930
Epoch 733
Validation auc = 0.619964
Epoch 734
Validation auc = 0.622581
Epoch 735
Loss = 1.0925e-03, PNorm = 105.0920, GNorm = 0.0343, lr_0 = 9.6383e-04
Loss = 4.1560e-05, PNorm = 105.0946, GNorm = 0.0023, lr_0 = 9.6381e-04
Validation auc = 0.624707
Epoch 736
Validation auc = 0.627542
Epoch 737
Validation auc = 0.630268
Epoch 738
Validation auc = 0.631413
Epoch 739
Validation auc = 0.624980
Epoch 740
Loss = 1.7484e-03, PNorm = 105.1115, GNorm = 0.0793, lr_0 = 9.6357e-04
Loss = 5.9078e-04, PNorm = 105.1123, GNorm = 0.0428, lr_0 = 9.6355e-04
Validation auc = 0.621981
Epoch 741
Validation auc = 0.620891
Epoch 742
Validation auc = 0.620836
Epoch 743
Validation auc = 0.619637
Epoch 744
Validation auc = 0.620237
Epoch 745
Loss = 1.5357e-03, PNorm = 105.1346, GNorm = 0.0270, lr_0 = 9.6333e-04
Validation auc = 0.621436
Epoch 746
Validation auc = 0.622472
Epoch 747
Validation auc = 0.622853
Epoch 748
Validation auc = 0.623508
Epoch 749
Loss = 2.1949e-04, PNorm = 105.1508, GNorm = 0.0024, lr_0 = 9.6309e-04
Validation auc = 0.623835
Epoch 750
Validation auc = 0.624325
Epoch 751
Validation auc = 0.624543
Epoch 752
Validation auc = 0.626070
Epoch 753
Validation auc = 0.628305
Epoch 754
Loss = 5.0079e-04, PNorm = 105.1660, GNorm = 0.0075, lr_0 = 9.6285e-04
Loss = 9.0527e-05, PNorm = 105.1673, GNorm = 0.0035, lr_0 = 9.6284e-04
Validation auc = 0.630540
Epoch 755
Validation auc = 0.631794
Epoch 756
Validation auc = 0.631576
Epoch 757
Validation auc = 0.630922
Epoch 758
Validation auc = 0.630540
Epoch 759
Loss = 1.7389e-03, PNorm = 105.1796, GNorm = 0.1160, lr_0 = 9.6262e-04
Validation auc = 0.630649
Epoch 760
Validation auc = 0.629886
Epoch 761
Validation auc = 0.629559
Epoch 762
Validation auc = 0.628850
Epoch 763
Validation auc = 0.626888
Epoch 764
Loss = 2.0509e-04, PNorm = 105.1953, GNorm = 0.0039, lr_0 = 9.6236e-04
Validation auc = 0.625634
Epoch 765
Validation auc = 0.624925
Epoch 766
Validation auc = 0.623835
Epoch 767
Validation auc = 0.623399
Epoch 768
Loss = 1.2031e-04, PNorm = 105.2024, GNorm = 0.0029, lr_0 = 9.6214e-04
Loss = 2.3583e-05, PNorm = 105.2027, GNorm = 0.0009, lr_0 = 9.6212e-04
Validation auc = 0.622581
Epoch 769
Validation auc = 0.622308
Epoch 770
Validation auc = 0.622145
Epoch 771
Validation auc = 0.621709
Epoch 772
Validation auc = 0.621272
Epoch 773
Loss = 5.7827e-02, PNorm = 105.2038, GNorm = 0.0019, lr_0 = 9.6188e-04
Loss = 1.2914e-06, PNorm = 105.2030, GNorm = 0.0001, lr_0 = 9.6186e-04
Validation auc = 0.615657
Epoch 774
Validation auc = 0.611187
Epoch 775
Validation auc = 0.607425
Epoch 776
Validation auc = 0.605517
Epoch 777
Validation auc = 0.604645
Epoch 778
Loss = 1.1089e-04, PNorm = 105.2040, GNorm = 0.0035, lr_0 = 9.6164e-04
Validation auc = 0.602737
Epoch 779
Validation auc = 0.601701
Epoch 780
Validation auc = 0.601428
Epoch 781
Validation auc = 0.600883
Epoch 782
Validation auc = 0.600720
Epoch 783
Loss = 5.3250e-04, PNorm = 105.2103, GNorm = 0.0221, lr_0 = 9.6139e-04
Validation auc = 0.599738
Epoch 784
Validation auc = 0.598975
Epoch 785
Validation auc = 0.598593
Epoch 786
Validation auc = 0.600011
Epoch 787
Loss = 2.1527e-04, PNorm = 105.2137, GNorm = 0.0073, lr_0 = 9.6117e-04
Loss = 3.1787e-05, PNorm = 105.2139, GNorm = 0.0013, lr_0 = 9.6115e-04
Validation auc = 0.600120
Epoch 788
Validation auc = 0.601428
Epoch 789
Validation auc = 0.602083
Epoch 790
Validation auc = 0.601592
Epoch 791
Validation auc = 0.601537
Epoch 792
Loss = 4.8204e-04, PNorm = 105.2190, GNorm = 0.0099, lr_0 = 9.6093e-04
Validation auc = 0.601646
Epoch 793
Validation auc = 0.601428
Epoch 794
Validation auc = 0.601755
Epoch 795
Validation auc = 0.601810
Epoch 796
Validation auc = 0.602083
Epoch 797
Loss = 1.0791e-04, PNorm = 105.2253, GNorm = 0.0023, lr_0 = 9.6067e-04
Validation auc = 0.602192
Epoch 798
Validation auc = 0.602519
Epoch 799
Validation auc = 0.602682
Epoch 800
Validation auc = 0.602682
Epoch 801
Loss = 3.9247e-02, PNorm = 105.2294, GNorm = 0.0019, lr_0 = 9.6045e-04
Loss = 6.4552e-04, PNorm = 105.2301, GNorm = 0.0138, lr_0 = 9.6043e-04
Validation auc = 0.603391
Epoch 802
Validation auc = 0.603882
Epoch 803
Validation auc = 0.604808
Epoch 804
Validation auc = 0.605081
Epoch 805
Validation auc = 0.605681
Epoch 806
Loss = 7.2733e-04, PNorm = 105.2408, GNorm = 0.0248, lr_0 = 9.6019e-04
Loss = 7.0954e-05, PNorm = 105.2415, GNorm = 0.0034, lr_0 = 9.6018e-04
Validation auc = 0.606062
Epoch 807
Validation auc = 0.606062
Epoch 808
Validation auc = 0.606607
Epoch 809
Validation auc = 0.606498
Epoch 810
Validation auc = 0.606716
Epoch 811
Loss = 1.4480e-04, PNorm = 105.2498, GNorm = 0.0024, lr_0 = 9.5996e-04
Validation auc = 0.606989
Epoch 812
Validation auc = 0.607207
Epoch 813
Validation auc = 0.607752
Epoch 814
Validation auc = 0.607698
Epoch 815
Validation auc = 0.607916
Epoch 816
Loss = 9.5354e-04, PNorm = 105.2566, GNorm = 0.0570, lr_0 = 9.5970e-04
Validation auc = 0.609170
Epoch 817
Validation auc = 0.610369
Epoch 818
Validation auc = 0.610751
Epoch 819
Validation auc = 0.610914
Epoch 820
Loss = 1.3041e-04, PNorm = 105.2616, GNorm = 0.0016, lr_0 = 9.5948e-04
Loss = 2.2907e-05, PNorm = 105.2619, GNorm = 0.0011, lr_0 = 9.5946e-04
Validation auc = 0.611296
Epoch 821
Validation auc = 0.611677
Epoch 822
Validation auc = 0.611677
Epoch 823
Validation auc = 0.611677
Epoch 824
Validation auc = 0.611568
Epoch 825
Loss = 3.0664e-02, PNorm = 105.2659, GNorm = 0.3275, lr_0 = 9.5924e-04
Validation auc = 0.611405
Epoch 826
Validation auc = 0.611350
Epoch 827
Validation auc = 0.611241
Epoch 828
Validation auc = 0.611787
Epoch 829
Validation auc = 0.612005
Epoch 830
Loss = 1.0730e-04, PNorm = 105.2791, GNorm = 0.0021, lr_0 = 9.5899e-04
Validation auc = 0.612332
Epoch 831
Validation auc = 0.612604
Epoch 832
Validation auc = 0.613258
Epoch 833
Validation auc = 0.613913
Epoch 834
Loss = 1.6321e-04, PNorm = 105.2873, GNorm = 0.0078, lr_0 = 9.5877e-04
Loss = 8.7003e-05, PNorm = 105.2878, GNorm = 0.0054, lr_0 = 9.5875e-04
Validation auc = 0.614512
Epoch 835
Validation auc = 0.615167
Epoch 836
Validation auc = 0.615548
Epoch 837
Validation auc = 0.615821
Epoch 838
Validation auc = 0.616039
Epoch 839
Loss = 8.6124e-05, PNorm = 105.2930, GNorm = 0.0010, lr_0 = 9.5851e-04
Loss = 5.4436e-05, PNorm = 105.2932, GNorm = 0.0020, lr_0 = 9.5849e-04
Validation auc = 0.616257
Epoch 840
Validation auc = 0.616748
Epoch 841
Validation auc = 0.616693
Epoch 842
Validation auc = 0.616966
Epoch 843
Validation auc = 0.616638
Epoch 844
Loss = 7.0346e-05, PNorm = 105.2957, GNorm = 0.0028, lr_0 = 9.5827e-04
Validation auc = 0.616366
Epoch 845
Validation auc = 0.616311
Epoch 846
Validation auc = 0.615930
Epoch 847
Validation auc = 0.615930
Epoch 848
Validation auc = 0.617947
Epoch 849
Loss = 6.5354e-04, PNorm = 105.2947, GNorm = 0.0348, lr_0 = 9.5802e-04
Validation auc = 0.619037
Epoch 850
Validation auc = 0.619419
Epoch 851
Validation auc = 0.624652
Epoch 852
Validation auc = 0.629286
Epoch 853
Loss = 2.2083e-03, PNorm = 105.3451, GNorm = 0.1783, lr_0 = 9.5780e-04
Loss = 4.2368e-04, PNorm = 105.3487, GNorm = 0.0199, lr_0 = 9.5778e-04
Validation auc = 0.634193
Epoch 854
Validation auc = 0.636755
Epoch 855
Validation auc = 0.634902
Epoch 856
Validation auc = 0.633702
Epoch 857
Validation auc = 0.633593
Epoch 858
Loss = 1.2860e-03, PNorm = 105.3853, GNorm = 0.0062, lr_0 = 9.5754e-04
Validation auc = 0.633103
Epoch 859
Validation auc = 0.632721
Epoch 860
Validation auc = 0.632612
Epoch 861
Validation auc = 0.632721
Epoch 862
Validation auc = 0.638718
Epoch 863
Loss = 5.7194e-02, PNorm = 105.3972, GNorm = 0.8606, lr_0 = 9.5730e-04
Validation auc = 0.639372
Epoch 864
Validation auc = 0.640190
Epoch 865
Validation auc = 0.641117
Epoch 866
Validation auc = 0.640462
Epoch 867
Loss = 1.7802e-03, PNorm = 105.4823, GNorm = 0.0052, lr_0 = 9.5708e-04
Loss = 3.4345e-04, PNorm = 105.4883, GNorm = 0.0117, lr_0 = 9.5707e-04
Validation auc = 0.639208
Epoch 868
Validation auc = 0.637137
Epoch 869
Validation auc = 0.635937
Epoch 870
Validation auc = 0.635392
Epoch 871
Validation auc = 0.630867
Epoch 872
Loss = 4.6899e-04, PNorm = 105.5355, GNorm = 0.0099, lr_0 = 9.5683e-04
Loss = 7.4223e-04, PNorm = 105.5371, GNorm = 0.0660, lr_0 = 9.5681e-04
Validation auc = 0.627978
Epoch 873
Validation auc = 0.625034
Epoch 874
Validation auc = 0.622090
Epoch 875
Validation auc = 0.619364
Epoch 876
Validation auc = 0.616966
Epoch 877
Loss = 1.3256e-04, PNorm = 105.5514, GNorm = 0.0037, lr_0 = 9.5659e-04
Validation auc = 0.615385
Epoch 878
Validation auc = 0.613695
Epoch 879
Validation auc = 0.612931
Epoch 880
Validation auc = 0.612604
Epoch 881
Validation auc = 0.612277
Epoch 882
Loss = 1.6262e-04, PNorm = 105.5604, GNorm = 0.0036, lr_0 = 9.5634e-04
Validation auc = 0.612277
Epoch 883
Validation auc = 0.612168
Epoch 884
Validation auc = 0.612005
Epoch 885
Validation auc = 0.612168
Epoch 886
Loss = 1.5654e-04, PNorm = 105.5676, GNorm = 0.0053, lr_0 = 9.5612e-04
Loss = 6.7999e-05, PNorm = 105.5680, GNorm = 0.0025, lr_0 = 9.5610e-04
Validation auc = 0.612168
Epoch 887
Validation auc = 0.612277
Epoch 888
Validation auc = 0.612059
Epoch 889
Validation auc = 0.611732
Epoch 890
Validation auc = 0.611459
Epoch 891
Loss = 4.3734e-04, PNorm = 105.5730, GNorm = 0.0027, lr_0 = 9.5586e-04
Validation auc = 0.611514
Epoch 892
Validation auc = 0.616857
Epoch 893
Validation auc = 0.619582
Epoch 894
Validation auc = 0.618928
Epoch 895
Validation auc = 0.606171
Epoch 896
Loss = 4.2496e-04, PNorm = 105.6791, GNorm = 0.0111, lr_0 = 9.5563e-04
Validation auc = 0.589980
Epoch 897
Validation auc = 0.565175
Epoch 898
Validation auc = 0.551764
Epoch 899
Validation auc = 0.552363
Epoch 900
Loss = 3.4406e-03, PNorm = 105.8360, GNorm = 0.0883, lr_0 = 9.5541e-04
Loss = 3.2382e-05, PNorm = 105.8460, GNorm = 0.0012, lr_0 = 9.5539e-04
Validation auc = 0.553181
Epoch 901
Validation auc = 0.556398
Epoch 902
Validation auc = 0.556997
Epoch 903
Validation auc = 0.558306
Epoch 904
Validation auc = 0.558796
Epoch 905
Loss = 3.8624e-02, PNorm = 105.9303, GNorm = 1.1707, lr_0 = 9.5515e-04
Loss = 2.5939e-04, PNorm = 105.9330, GNorm = 0.0122, lr_0 = 9.5513e-04
Validation auc = 0.563703
Epoch 906
Validation auc = 0.567246
Epoch 907
Validation auc = 0.571662
Epoch 908
Validation auc = 0.577223
Epoch 909
Validation auc = 0.580821
Epoch 910
Loss = 1.0810e-03, PNorm = 106.0255, GNorm = 0.0535, lr_0 = 9.5491e-04
Validation auc = 0.584692
Epoch 911
Validation auc = 0.586109
Epoch 912
Validation auc = 0.583601
Epoch 913
Validation auc = 0.581911
Epoch 914
Validation auc = 0.581366
Epoch 915
Loss = 1.4184e-03, PNorm = 106.0984, GNorm = 0.0254, lr_0 = 9.5466e-04
Validation auc = 0.581366
Epoch 916
Validation auc = 0.593087
Epoch 917
Validation auc = 0.593687
Epoch 918
Validation auc = 0.594723
Epoch 919
Loss = 1.1796e-03, PNorm = 106.1762, GNorm = 0.0137, lr_0 = 9.5444e-04
Loss = 2.8968e-03, PNorm = 106.1851, GNorm = 0.0628, lr_0 = 9.5442e-04
Validation auc = 0.602900
Epoch 920
Validation auc = 0.602301
Epoch 921
Validation auc = 0.602955
Epoch 922
Validation auc = 0.598484
Epoch 923
Validation auc = 0.595213
Epoch 924
Loss = 4.6702e-03, PNorm = 106.2467, GNorm = 0.5586, lr_0 = 9.5419e-04
Validation auc = 0.594614
Epoch 925
Validation auc = 0.596140
Epoch 926
Validation auc = 0.598866
Epoch 927
Validation auc = 0.598484
Epoch 928
Validation auc = 0.604863
Epoch 929
Loss = 2.7049e-04, PNorm = 106.3094, GNorm = 0.0079, lr_0 = 9.5395e-04
Validation auc = 0.608843
Epoch 930
Validation auc = 0.612441
Epoch 931
Validation auc = 0.615112
Epoch 932
Validation auc = 0.615930
Epoch 933
Loss = 7.7955e-05, PNorm = 106.3780, GNorm = 0.0016, lr_0 = 9.5371e-04
Validation auc = 0.615657
Epoch 934
Validation auc = 0.617729
Epoch 935
Validation auc = 0.639154
Epoch 936
Validation auc = 0.662814
Epoch 937
Validation auc = 0.637791
Epoch 938
Loss = 1.4024e-01, PNorm = 107.0271, GNorm = 1.6271, lr_0 = 9.5348e-04
Loss = 3.1816e-02, PNorm = 107.0993, GNorm = 0.7671, lr_0 = 9.5346e-04
Validation auc = 0.571989
Epoch 939
Validation auc = 0.618601
Epoch 940
Validation auc = 0.625034
Epoch 941
Validation auc = 0.641825
Epoch 942
Validation auc = 0.642752
Epoch 943
Loss = 3.3880e-02, PNorm = 108.2100, GNorm = 0.5767, lr_0 = 9.5324e-04
Validation auc = 0.638173
Epoch 944
Validation auc = 0.633702
Epoch 945
Validation auc = 0.627160
Epoch 946
Validation auc = 0.627433
Epoch 947
Validation auc = 0.638118
Epoch 948
Loss = 2.1085e-02, PNorm = 109.0673, GNorm = 0.5174, lr_0 = 9.5299e-04
Validation auc = 0.642916
Epoch 949
Validation auc = 0.625470
Epoch 950
Validation auc = 0.608734
Epoch 951
Validation auc = 0.626342
Epoch 952
Loss = 2.9961e-01, PNorm = 109.4916, GNorm = 5.8927, lr_0 = 9.5277e-04
Loss = 1.0780e-03, PNorm = 109.5558, GNorm = 0.0559, lr_0 = 9.5275e-04
Validation auc = 0.681023
Epoch 953
Validation auc = 0.672954
Epoch 954
Validation auc = 0.614785
Epoch 955
Validation auc = 0.590907
Epoch 956
Validation auc = 0.582347
Epoch 957
Loss = 1.2015e-01, PNorm = 111.0009, GNorm = 0.9702, lr_0 = 9.5251e-04
Loss = 5.0361e-02, PNorm = 111.0938, GNorm = 1.0212, lr_0 = 9.5250e-04
Validation auc = 0.595650
Epoch 958
Validation auc = 0.618165
Epoch 959
Validation auc = 0.619473
Epoch 960
Validation auc = 0.628905
Epoch 961
Validation auc = 0.647004
Epoch 962
Loss = 5.3818e-02, PNorm = 111.9292, GNorm = 0.8830, lr_0 = 9.5228e-04
Validation auc = 0.655727
Epoch 963
Validation auc = 0.601919
Epoch 964
Validation auc = 0.639154
Epoch 965
Validation auc = 0.646950
Epoch 966
Loss = 1.3975e-01, PNorm = 112.7905, GNorm = 0.2018, lr_0 = 9.5204e-04
Validation auc = 0.653274
Epoch 967
Validation auc = 0.658071
Epoch 968
Validation auc = 0.667666
Epoch 969
Validation auc = 0.669029
Epoch 970
Validation auc = 0.655454
Epoch 971
Loss = 5.5016e-02, PNorm = 113.3892, GNorm = 0.1888, lr_0 = 9.5180e-04
Loss = 1.1332e-02, PNorm = 113.4189, GNorm = 0.3489, lr_0 = 9.5179e-04
Validation auc = 0.645641
Epoch 972
Validation auc = 0.635011
Epoch 973
Validation auc = 0.624325
Epoch 974
Validation auc = 0.614894
Epoch 975
Validation auc = 0.602083
Epoch 976
Loss = 2.0656e-02, PNorm = 113.6935, GNorm = 0.3820, lr_0 = 9.5157e-04
Validation auc = 0.584310
Epoch 977
Validation auc = 0.582293
Epoch 978
Validation auc = 0.561958
Epoch 979
Validation auc = 0.613422
Epoch 980
Validation auc = 0.660961
Epoch 981
Loss = 5.1603e-02, PNorm = 113.9703, GNorm = 1.5888, lr_0 = 9.5132e-04
Validation auc = 0.678569
Epoch 982
Validation auc = 0.685111
Epoch 983
Validation auc = 0.688655
Epoch 984
Validation auc = 0.690672
Epoch 985
Loss = 3.0313e-03, PNorm = 114.2892, GNorm = 0.1547, lr_0 = 9.5110e-04
Loss = 7.8550e-03, PNorm = 114.3061, GNorm = 0.1739, lr_0 = 9.5108e-04
Validation auc = 0.690945
Epoch 986
Validation auc = 0.689255
Epoch 987
Validation auc = 0.683585
Epoch 988
Validation auc = 0.679278
Epoch 989
Validation auc = 0.682113
Epoch 990
Loss = 4.5791e-03, PNorm = 114.4976, GNorm = 0.1452, lr_0 = 9.5084e-04
Loss = 2.9562e-05, PNorm = 114.5091, GNorm = 0.0013, lr_0 = 9.5083e-04
Validation auc = 0.684403
Epoch 991
Validation auc = 0.687946
Epoch 992
Validation auc = 0.690127
Epoch 993
Validation auc = 0.689527
Epoch 994
Validation auc = 0.688110
Epoch 995
Loss = 2.3594e-04, PNorm = 114.6274, GNorm = 0.0061, lr_0 = 9.5061e-04
Validation auc = 0.688001
Epoch 996
Validation auc = 0.686747
Epoch 997
Validation auc = 0.691981
Epoch 998
Validation auc = 0.696451
Epoch 999
Loss = 8.3674e-03, PNorm = 114.6897, GNorm = 0.4214, lr_0 = 9.5037e-04
Validation auc = 0.693616
Epoch 1000
Validation auc = 0.688437
Epoch 1001
Validation auc = 0.672191
Epoch 1002
Validation auc = 0.661015
Epoch 1003
Validation auc = 0.649349
Epoch 1004
Loss = 4.2403e-02, PNorm = 114.7891, GNorm = 0.0075, lr_0 = 9.5014e-04
Loss = 5.1930e-04, PNorm = 114.7999, GNorm = 0.0208, lr_0 = 9.5012e-04
Validation auc = 0.646241
Epoch 1005
Validation auc = 0.645478
Epoch 1006
Validation auc = 0.646132
Epoch 1007
Validation auc = 0.642697
Epoch 1008
Validation auc = 0.639863
Epoch 1009
Loss = 2.3440e-03, PNorm = 114.9062, GNorm = 0.0387, lr_0 = 9.4990e-04
Validation auc = 0.639808
Epoch 1010
Validation auc = 0.634847
Epoch 1011
Validation auc = 0.632830
Epoch 1012
Validation auc = 0.632557
Epoch 1013
Validation auc = 0.635174
Epoch 1014
Loss = 8.8840e-03, PNorm = 115.0271, GNorm = 0.1796, lr_0 = 9.4965e-04
Validation auc = 0.638173
Epoch 1015
Validation auc = 0.642043
Epoch 1016
Validation auc = 0.648149
Epoch 1017
Validation auc = 0.651529
Epoch 1018
Loss = 4.7478e-03, PNorm = 115.1068, GNorm = 0.1919, lr_0 = 9.4943e-04
Loss = 2.1615e-03, PNorm = 115.1122, GNorm = 0.1043, lr_0 = 9.4941e-04
Validation auc = 0.654473
Epoch 1019
Validation auc = 0.656163
Epoch 1020
Validation auc = 0.652183
Epoch 1021
Validation auc = 0.648912
Epoch 1022
Validation auc = 0.646568
Epoch 1023
Loss = 9.9003e-03, PNorm = 115.2056, GNorm = 0.4855, lr_0 = 9.4918e-04
Loss = 6.9079e-04, PNorm = 115.2138, GNorm = 0.0225, lr_0 = 9.4916e-04
Validation auc = 0.647059
Epoch 1024
Validation auc = 0.647277
Epoch 1025
Validation auc = 0.646677
Epoch 1026
Validation auc = 0.645369
Epoch 1027
Validation auc = 0.645205
Epoch 1028
Loss = 6.7446e-04, PNorm = 115.2971, GNorm = 0.0141, lr_0 = 9.4894e-04
Validation auc = 0.645423
Epoch 1029
Validation auc = 0.644660
Epoch 1030
Validation auc = 0.644442
Epoch 1031
Validation auc = 0.643897
Epoch 1032
Validation auc = 0.643951
Epoch 1033
Loss = 3.3422e-04, PNorm = 115.3398, GNorm = 0.0062, lr_0 = 9.4869e-04
Validation auc = 0.644715
Epoch 1034
Validation auc = 0.644660
Epoch 1035
Validation auc = 0.644769
Epoch 1036
Validation auc = 0.644933
Epoch 1037
Loss = 2.7066e-04, PNorm = 115.3524, GNorm = 0.0036, lr_0 = 9.4847e-04
Loss = 1.6056e-04, PNorm = 115.3530, GNorm = 0.0046, lr_0 = 9.4845e-04
Validation auc = 0.644497
Epoch 1038
Validation auc = 0.640135
Epoch 1039
Validation auc = 0.635501
Epoch 1040
Validation auc = 0.627378
Epoch 1041
Validation auc = 0.621981
Epoch 1042
Loss = 1.4600e-03, PNorm = 115.3946, GNorm = 0.0401, lr_0 = 9.4823e-04
Validation auc = 0.619800
Epoch 1043
Validation auc = 0.619146
Epoch 1044
Validation auc = 0.622799
Epoch 1045
Validation auc = 0.626724
Epoch 1046
Validation auc = 0.629450
Epoch 1047
Loss = 4.0664e-03, PNorm = 115.4443, GNorm = 0.1684, lr_0 = 9.4798e-04
Validation auc = 0.630704
Epoch 1048
Validation auc = 0.638064
Epoch 1049
Validation auc = 0.642588
Epoch 1050
Validation auc = 0.646023
Epoch 1051
Loss = 9.0596e-04, PNorm = 115.4889, GNorm = 0.0145, lr_0 = 9.4776e-04
Loss = 2.6217e-03, PNorm = 115.4916, GNorm = 0.1251, lr_0 = 9.4775e-04
Validation auc = 0.648694
Epoch 1052
Validation auc = 0.650384
Epoch 1053
Validation auc = 0.651039
Epoch 1054
Validation auc = 0.652620
Epoch 1055
Validation auc = 0.653328
Epoch 1056
Loss = 2.9961e-04, PNorm = 115.5170, GNorm = 0.0032, lr_0 = 9.4751e-04
Loss = 2.3021e-04, PNorm = 115.5180, GNorm = 0.0176, lr_0 = 9.4749e-04
Validation auc = 0.653328
Epoch 1057
Validation auc = 0.653764
Epoch 1058
Validation auc = 0.653982
Epoch 1059
Validation auc = 0.655836
Epoch 1060
Validation auc = 0.657417
Epoch 1061
Loss = 3.3926e-04, PNorm = 115.5315, GNorm = 0.0062, lr_0 = 9.4728e-04
Validation auc = 0.658616
Epoch 1062
Validation auc = 0.659598
Epoch 1063
Validation auc = 0.661833
Epoch 1064
Validation auc = 0.659761
Epoch 1065
Validation auc = 0.658235
Epoch 1066
Loss = 3.1315e-03, PNorm = 115.5522, GNorm = 0.1338, lr_0 = 9.4702e-04
Validation auc = 0.659107
Epoch 1067
Validation auc = 0.639426
Epoch 1068
Validation auc = 0.623181
Epoch 1069
Validation auc = 0.618383
Epoch 1070
Loss = 1.1116e-03, PNorm = 115.6060, GNorm = 0.0366, lr_0 = 9.4681e-04
Loss = 1.1267e-03, PNorm = 115.6097, GNorm = 0.0739, lr_0 = 9.4679e-04
Validation auc = 0.618001
Epoch 1071
Validation auc = 0.617129
Epoch 1072
Validation auc = 0.619691
Epoch 1073
Validation auc = 0.622962
Epoch 1074
Validation auc = 0.633539
Epoch 1075
Loss = 4.1767e-02, PNorm = 115.6417, GNorm = 1.8149, lr_0 = 9.4657e-04
Validation auc = 0.647113
Epoch 1076
Validation auc = 0.655781
Epoch 1077
Validation auc = 0.658943
Epoch 1078
Validation auc = 0.660633
Epoch 1079
Validation auc = 0.659652
Epoch 1080
Loss = 6.5739e-03, PNorm = 115.7784, GNorm = 0.2099, lr_0 = 9.4632e-04
Validation auc = 0.657199
Epoch 1081
Validation auc = 0.656272
Epoch 1082
Validation auc = 0.656872
Epoch 1083
Validation auc = 0.633266
Epoch 1084
Loss = 4.9468e-03, PNorm = 115.9331, GNorm = 0.5757, lr_0 = 9.4610e-04
Loss = 9.2386e-06, PNorm = 115.9609, GNorm = 0.0003, lr_0 = 9.4608e-04
Validation auc = 0.615003
Epoch 1085
Validation auc = 0.611787
Epoch 1086
Validation auc = 0.604863
Epoch 1087
Validation auc = 0.618492
Epoch 1088
Validation auc = 0.626397
Epoch 1089
Loss = 4.5726e-02, PNorm = 116.4169, GNorm = 2.9096, lr_0 = 9.4585e-04
Loss = 6.1705e-04, PNorm = 116.4447, GNorm = 0.0299, lr_0 = 9.4583e-04
Validation auc = 0.623780
Epoch 1090
Validation auc = 0.628142
Epoch 1091
Validation auc = 0.631522
Epoch 1092
Validation auc = 0.662051
Epoch 1093
Validation auc = 0.661615
Epoch 1094
Loss = 1.3939e-01, PNorm = 117.0778, GNorm = 2.4384, lr_0 = 9.4561e-04
Validation auc = 0.644388
Epoch 1095
Validation auc = 0.650112
Epoch 1096
Validation auc = 0.649894
Epoch 1097
Validation auc = 0.641771
Epoch 1098
Validation auc = 0.647931
Epoch 1099
Loss = 1.0169e-02, PNorm = 117.8233, GNorm = 0.2418, lr_0 = 9.4536e-04
Validation auc = 0.658344
Epoch 1100
Validation auc = 0.665049
Epoch 1101
Validation auc = 0.664232
Epoch 1102
Validation auc = 0.662651
Epoch 1103
Loss = 9.9711e-03, PNorm = 118.1772, GNorm = 0.3925, lr_0 = 9.4515e-04
Loss = 1.6520e-03, PNorm = 118.1944, GNorm = 0.0530, lr_0 = 9.4513e-04
Validation auc = 0.663250
Epoch 1104
Validation auc = 0.664232
Epoch 1105
Validation auc = 0.660797
Epoch 1106
Validation auc = 0.649567
Epoch 1107
Validation auc = 0.646241
Epoch 1108
Loss = 3.3992e-02, PNorm = 118.3764, GNorm = 0.1786, lr_0 = 9.4489e-04
Validation auc = 0.652620
Epoch 1109
Validation auc = 0.654855
Epoch 1110
Validation auc = 0.631685
Epoch 1111
Validation auc = 0.693234
Epoch 1112
Validation auc = 0.712970
Epoch 1113
Loss = 3.3473e-02, PNorm = 118.5279, GNorm = 0.6246, lr_0 = 9.4466e-04
Validation auc = 0.716513
Epoch 1114
Validation auc = 0.715259
Epoch 1115
Validation auc = 0.708717
Epoch 1116
Validation auc = 0.702829
Epoch 1117
Loss = 2.0908e-02, PNorm = 118.6881, GNorm = 0.8251, lr_0 = 9.4444e-04
Loss = 4.8518e-03, PNorm = 118.6998, GNorm = 0.2010, lr_0 = 9.4443e-04
Validation auc = 0.704192
Epoch 1118
Validation auc = 0.701685
Epoch 1119
Validation auc = 0.701794
Epoch 1120
Validation auc = 0.702230
Epoch 1121
Validation auc = 0.704356
Epoch 1122
Loss = 1.0399e-02, PNorm = 118.8157, GNorm = 0.0191, lr_0 = 9.4419e-04
Loss = 3.2388e-04, PNorm = 118.8208, GNorm = 0.0108, lr_0 = 9.4417e-04
Validation auc = 0.702175
Epoch 1123
Validation auc = 0.700649
Epoch 1124
Validation auc = 0.699776
Epoch 1125
Validation auc = 0.698577
Epoch 1126
Validation auc = 0.696287
Epoch 1127
Loss = 6.1544e-03, PNorm = 118.8801, GNorm = 0.1070, lr_0 = 9.4396e-04
Validation auc = 0.694706
Epoch 1128
Validation auc = 0.694161
Epoch 1129
Validation auc = 0.694161
Epoch 1130
Validation auc = 0.694325
Epoch 1131
Validation auc = 0.694652
Epoch 1132
Loss = 4.4983e-03, PNorm = 118.9282, GNorm = 0.0836, lr_0 = 9.4371e-04
Validation auc = 0.694161
Epoch 1133
Validation auc = 0.693180
Epoch 1134
Validation auc = 0.692798
Epoch 1135
Validation auc = 0.691763
Epoch 1136
Loss = 2.0403e-03, PNorm = 118.9531, GNorm = 0.0141, lr_0 = 9.4349e-04
Loss = 5.2459e-04, PNorm = 118.9545, GNorm = 0.0162, lr_0 = 9.4347e-04
Validation auc = 0.692580
Epoch 1137
Validation auc = 0.693125
Epoch 1138
Validation auc = 0.689309
Epoch 1139
Validation auc = 0.685984
Epoch 1140
Validation auc = 0.683421
Epoch 1141
Loss = 6.7010e-04, PNorm = 118.9694, GNorm = 0.0062, lr_0 = 9.4324e-04
Validation auc = 0.681404
Epoch 1142
Validation auc = 0.679660
Epoch 1143
Validation auc = 0.678351
Epoch 1144
Validation auc = 0.678242
Epoch 1145
Validation auc = 0.678242
Epoch 1146
Loss = 3.5640e-02, PNorm = 118.9831, GNorm = 0.5387, lr_0 = 9.4300e-04
Validation auc = 0.680150
Epoch 1147
Validation auc = 0.682004
Epoch 1148
Validation auc = 0.684021
Epoch 1149
Validation auc = 0.684021
Epoch 1150
Loss = 2.9943e-03, PNorm = 119.0015, GNorm = 0.0198, lr_0 = 9.4279e-04
Loss = 6.8589e-04, PNorm = 119.0030, GNorm = 0.0283, lr_0 = 9.4277e-04
Validation auc = 0.683367
Epoch 1151
Validation auc = 0.682386
Epoch 1152
Validation auc = 0.681895
Epoch 1153
Validation auc = 0.680369
Epoch 1154
Validation auc = 0.680641
Epoch 1155
Loss = 7.8400e-04, PNorm = 119.0406, GNorm = 0.0077, lr_0 = 9.4253e-04
Loss = 5.6320e-05, PNorm = 119.0492, GNorm = 0.0016, lr_0 = 9.4252e-04
Validation auc = 0.668811
Epoch 1156
Validation auc = 0.657853
Epoch 1157
Validation auc = 0.651420
Epoch 1158
Validation auc = 0.649403
Epoch 1159
Validation auc = 0.648149
Epoch 1160
Loss = 2.6092e-03, PNorm = 119.1647, GNorm = 0.0681, lr_0 = 9.4230e-04
Validation auc = 0.650657
Epoch 1161
Validation auc = 0.652783
Epoch 1162
Validation auc = 0.657362
Epoch 1163
Validation auc = 0.662978
Epoch 1164
Validation auc = 0.665704
Epoch 1165
Loss = 5.7299e-04, PNorm = 119.2703, GNorm = 0.0126, lr_0 = 9.4205e-04
Validation auc = 0.669084
Epoch 1166
Validation auc = 0.672518
Epoch 1167
Validation auc = 0.673063
Epoch 1168
Validation auc = 0.668866
Epoch 1169
Loss = 1.0505e-03, PNorm = 119.3158, GNorm = 0.0364, lr_0 = 9.4183e-04
Loss = 3.3556e-03, PNorm = 119.3183, GNorm = 0.1129, lr_0 = 9.4182e-04
Validation auc = 0.665376
Epoch 1170
Validation auc = 0.665104
Epoch 1171
Validation auc = 0.669247
Epoch 1172
Validation auc = 0.658507
Epoch 1173
Validation auc = 0.650820
Epoch 1174
Loss = 2.3182e-03, PNorm = 119.4082, GNorm = 0.0646, lr_0 = 9.4158e-04
Validation auc = 0.651584
Epoch 1175
Validation auc = 0.651311
Epoch 1176
Validation auc = 0.651366
Epoch 1177
Validation auc = 0.630649
Epoch 1178
Validation auc = 0.624761
Epoch 1179
Loss = 3.7083e-03, PNorm = 119.5009, GNorm = 0.1589, lr_0 = 9.4135e-04
Validation auc = 0.632285
Epoch 1180
Validation auc = 0.638936
Epoch 1181
Validation auc = 0.643079
Epoch 1182
Validation auc = 0.647659
Epoch 1183
Loss = 5.1369e-03, PNorm = 119.6454, GNorm = 0.3441, lr_0 = 9.4112e-04
Validation auc = 0.650439
Epoch 1184
Validation auc = 0.654310
Epoch 1185
Validation auc = 0.651638
Epoch 1186
Validation auc = 0.650711
Epoch 1187
Validation auc = 0.647113
Epoch 1188
Loss = 3.8118e-03, PNorm = 119.7310, GNorm = 0.0515, lr_0 = 9.4088e-04
Loss = 8.7111e-04, PNorm = 119.7350, GNorm = 0.0254, lr_0 = 9.4087e-04
Validation auc = 0.645260
Epoch 1189
Validation auc = 0.643842
Epoch 1190
Validation auc = 0.643352
Epoch 1191
Validation auc = 0.642807
Epoch 1192
Validation auc = 0.643188
Epoch 1193
Loss = 7.4226e-04, PNorm = 119.7776, GNorm = 0.0168, lr_0 = 9.4065e-04
Validation auc = 0.644987
Epoch 1194
Validation auc = 0.640244
Epoch 1195
Validation auc = 0.640135
Epoch 1196
Validation auc = 0.641716
Epoch 1197
Validation auc = 0.653764
Epoch 1198
Loss = 1.0825e-02, PNorm = 119.8564, GNorm = 0.3536, lr_0 = 9.4040e-04
Validation auc = 0.662214
Epoch 1199
Validation auc = 0.658071
Epoch 1200
Validation auc = 0.654637
Epoch 1201
Validation auc = 0.652729
Epoch 1202
Loss = 2.0086e-03, PNorm = 119.9839, GNorm = 0.0487, lr_0 = 9.4018e-04
Loss = 1.0818e-04, PNorm = 119.9913, GNorm = 0.0042, lr_0 = 9.4016e-04
Validation auc = 0.651529
Epoch 1203
Validation auc = 0.651856
Epoch 1204
Validation auc = 0.651529
Epoch 1205
Validation auc = 0.651638
Epoch 1206
Validation auc = 0.650766
Epoch 1207
Loss = 1.3296e-01, PNorm = 120.0567, GNorm = 0.0489, lr_0 = 9.3993e-04
Loss = 1.9702e-03, PNorm = 120.0544, GNorm = 0.0889, lr_0 = 9.3991e-04
Validation auc = 0.656926
Epoch 1208
Validation auc = 0.663141
Epoch 1209
Validation auc = 0.662105
Epoch 1210
Validation auc = 0.662869
Epoch 1211
Validation auc = 0.662214
Epoch 1212
Loss = 2.1452e-03, PNorm = 120.1537, GNorm = 0.0391, lr_0 = 9.3970e-04
Validation auc = 0.662705
Epoch 1213
Validation auc = 0.664559
Epoch 1214
Validation auc = 0.663250
Epoch 1215
Validation auc = 0.651638
Epoch 1216
Loss = 2.2389e-01, PNorm = 120.4036, GNorm = 12.8657, lr_0 = 9.3946e-04
Validation auc = 0.672355
Epoch 1217
Validation auc = 0.659325
Epoch 1218
Validation auc = 0.667066
Epoch 1219
Validation auc = 0.660852
Epoch 1220
Validation auc = 0.636755
Epoch 1221
Loss = 4.5140e-01, PNorm = 121.5646, GNorm = 0.6854, lr_0 = 9.3923e-04
Loss = 8.3214e-02, PNorm = 121.6386, GNorm = 1.6486, lr_0 = 9.3922e-04
Validation auc = 0.647604
Epoch 1222
Validation auc = 0.650493
Epoch 1223
Validation auc = 0.647713
Epoch 1224
Validation auc = 0.641444
Epoch 1225
Validation auc = 0.633375
Epoch 1226
Loss = 9.7356e-03, PNorm = 122.3717, GNorm = 0.1378, lr_0 = 9.3900e-04
Validation auc = 0.624925
Epoch 1227
Validation auc = 0.624871
Epoch 1228
Validation auc = 0.618710
Epoch 1229
Validation auc = 0.604318
Epoch 1230
Validation auc = 0.578858
Epoch 1231
Loss = 7.6617e-03, PNorm = 122.8606, GNorm = 0.3041, lr_0 = 9.3875e-04
Validation auc = 0.572862
Epoch 1232
Validation auc = 0.591179
Epoch 1233
Validation auc = 0.607752
Epoch 1234
Validation auc = 0.615058
Epoch 1235
Loss = 3.3629e-02, PNorm = 123.1185, GNorm = 0.7636, lr_0 = 9.3853e-04
Loss = 4.6304e-01, PNorm = 123.1358, GNorm = 6.9847, lr_0 = 9.3852e-04
Validation auc = 0.613858
Epoch 1236
Validation auc = 0.606280
Epoch 1237
Validation auc = 0.602410
Epoch 1238
Validation auc = 0.600720
Epoch 1239
Validation auc = 0.598266
Epoch 1240
Loss = 4.8607e-02, PNorm = 123.4428, GNorm = 1.8792, lr_0 = 9.3828e-04
Loss = 1.6220e-02, PNorm = 123.4627, GNorm = 0.3098, lr_0 = 9.3827e-04
Validation auc = 0.605245
Epoch 1241
Validation auc = 0.614621
Epoch 1242
Validation auc = 0.620945
Epoch 1243
Validation auc = 0.626506
Epoch 1244
Validation auc = 0.628523
Epoch 1245
Loss = 4.9284e-03, PNorm = 123.6799, GNorm = 0.0932, lr_0 = 9.3805e-04
Validation auc = 0.629123
Epoch 1246
Validation auc = 0.628196
Epoch 1247
Validation auc = 0.624543
Epoch 1248
Validation auc = 0.621327
Epoch 1249
Loss = 5.9303e-02, PNorm = 123.8455, GNorm = 0.3342, lr_0 = 9.3782e-04
Validation auc = 0.607371
Epoch 1250
Validation auc = 0.605517
Epoch 1251
Validation auc = 0.605735
Epoch 1252
Validation auc = 0.603091
Epoch 1253
Validation auc = 0.601537
Epoch 1254
Loss = 2.2722e-02, PNorm = 124.0916, GNorm = 0.0978, lr_0 = 9.3758e-04
Loss = 7.1858e-05, PNorm = 124.1032, GNorm = 0.0028, lr_0 = 9.3757e-04
Validation auc = 0.599520
Epoch 1255
Validation auc = 0.590089
Epoch 1256
Validation auc = 0.582238
Epoch 1257
Validation auc = 0.574606
Epoch 1258
Validation auc = 0.570136
Epoch 1259
Loss = 3.1541e-03, PNorm = 124.2547, GNorm = 0.0378, lr_0 = 9.3735e-04
Validation auc = 0.643297
Epoch 1260
Validation auc = 0.578041
Epoch 1261
Validation auc = 0.637028
Epoch 1262
Validation auc = 0.635011
Epoch 1263
Validation auc = 0.643461
Epoch 1264
Loss = 1.6386e-02, PNorm = 124.9353, GNorm = 0.2984, lr_0 = 9.3710e-04
Validation auc = 0.645914
Epoch 1265
Validation auc = 0.639481
Epoch 1266
Validation auc = 0.619855
Epoch 1267
Validation auc = 0.588126
Epoch 1268
Loss = 1.6498e-02, PNorm = 125.3400, GNorm = 0.0836, lr_0 = 9.3689e-04
Loss = 5.4039e-04, PNorm = 125.3633, GNorm = 0.0202, lr_0 = 9.3687e-04
Validation auc = 0.562940
Epoch 1269
Validation auc = 0.550455
Epoch 1270
Validation auc = 0.543586
Epoch 1271
Validation auc = 0.546475
Epoch 1272
Validation auc = 0.552963
Epoch 1273
Loss = 6.1216e-03, PNorm = 125.5707, GNorm = 0.0802, lr_0 = 9.3664e-04
Loss = 8.7867e-05, PNorm = 125.5797, GNorm = 0.0033, lr_0 = 9.3662e-04
Validation auc = 0.560813
Epoch 1274
Validation auc = 0.568991
Epoch 1275
Validation auc = 0.581693
Epoch 1276
Validation auc = 0.588562
Epoch 1277
Validation auc = 0.591615
Epoch 1278
Loss = 2.4593e-03, PNorm = 125.6790, GNorm = 0.1156, lr_0 = 9.3641e-04
Validation auc = 0.605190
Epoch 1279
Validation auc = 0.614403
Epoch 1280
Validation auc = 0.612659
Epoch 1281
Validation auc = 0.605190
Epoch 1282
Validation auc = 0.594341
Epoch 1283
Loss = 1.3828e-02, PNorm = 125.7919, GNorm = 0.6334, lr_0 = 9.3616e-04
Validation auc = 0.584310
Epoch 1284
Validation auc = 0.577223
Epoch 1285
Validation auc = 0.574115
Epoch 1286
Validation auc = 0.566429
Epoch 1287
Loss = 3.9222e-03, PNorm = 125.9309, GNorm = 0.2109, lr_0 = 9.3594e-04
Loss = 4.4525e-03, PNorm = 125.9412, GNorm = 0.1372, lr_0 = 9.3592e-04
Validation auc = 0.558960
Epoch 1288
Validation auc = 0.551600
Epoch 1289
Validation auc = 0.547293
Epoch 1290
Validation auc = 0.546530
Epoch 1291
Validation auc = 0.548056
Epoch 1292
Loss = 6.3114e-04, PNorm = 126.0348, GNorm = 0.0143, lr_0 = 9.3571e-04
Validation auc = 0.547947
Epoch 1293
Validation auc = 0.558524
Epoch 1294
Validation auc = 0.564793
Epoch 1295
Validation auc = 0.571444
Epoch 1296
Validation auc = 0.575260
Epoch 1297
Loss = 1.0903e-02, PNorm = 126.2003, GNorm = 0.2392, lr_0 = 9.3546e-04
Validation auc = 0.573298
Epoch 1298
Validation auc = 0.571390
Epoch 1299
Validation auc = 0.568010
Epoch 1300
Validation auc = 0.557597
Epoch 1301
Loss = 9.4077e-03, PNorm = 126.3267, GNorm = 0.2795, lr_0 = 9.3524e-04
Loss = 8.8313e-03, PNorm = 126.3391, GNorm = 0.3262, lr_0 = 9.3523e-04
Validation auc = 0.546148
Epoch 1302
Validation auc = 0.533719
Epoch 1303
Validation auc = 0.524451
Epoch 1304
Validation auc = 0.519381
Epoch 1305
Validation auc = 0.517200
Epoch 1306
Loss = 8.4229e-04, PNorm = 126.4859, GNorm = 0.0172, lr_0 = 9.3499e-04
Loss = 2.5309e-03, PNorm = 126.4930, GNorm = 0.0808, lr_0 = 9.3498e-04
Validation auc = 0.516001
Epoch 1307
Validation auc = 0.511694
Epoch 1308
Validation auc = 0.505479
Epoch 1309
Validation auc = 0.500954
Epoch 1310
Validation auc = 0.499373
Epoch 1311
Loss = 1.8709e-03, PNorm = 126.5591, GNorm = 0.0571, lr_0 = 9.3476e-04
Validation auc = 0.495611
Epoch 1312
Validation auc = 0.497901
Epoch 1313
Validation auc = 0.502644
Epoch 1314
Validation auc = 0.508096
Epoch 1315
Validation auc = 0.511694
Epoch 1316
Loss = 8.0324e-04, PNorm = 126.5912, GNorm = 0.0148, lr_0 = 9.3451e-04
Validation auc = 0.515565
Epoch 1317
Validation auc = 0.518345
Epoch 1318
Validation auc = 0.515946
Epoch 1319
Validation auc = 0.513384
Epoch 1320
Loss = 8.7387e-03, PNorm = 126.6128, GNorm = 1.2704, lr_0 = 9.3430e-04
Loss = 7.5846e-05, PNorm = 126.6164, GNorm = 0.0028, lr_0 = 9.3428e-04
Validation auc = 0.512021
Epoch 1321
Validation auc = 0.509731
Epoch 1322
Validation auc = 0.506896
Epoch 1323
Validation auc = 0.525105
Epoch 1324
Validation auc = 0.536772
Epoch 1325
Loss = 7.5344e-03, PNorm = 126.6890, GNorm = 0.3516, lr_0 = 9.3407e-04
Validation auc = 0.530557
Epoch 1326
Validation auc = 0.493322
Epoch 1327
Validation auc = 0.472278
Epoch 1328
Validation auc = 0.528212
Epoch 1329
Validation auc = 0.594886
Epoch 1330
Loss = 1.3925e-03, PNorm = 126.8181, GNorm = 0.0502, lr_0 = 9.3382e-04
Validation auc = 0.622526
Epoch 1331
Validation auc = 0.635883
Epoch 1332
Validation auc = 0.640953
Epoch 1333
Validation auc = 0.644660
Epoch 1334
Loss = 1.3047e-03, PNorm = 126.9024, GNorm = 0.0056, lr_0 = 9.3360e-04
Loss = 1.0627e-03, PNorm = 126.9069, GNorm = 0.0548, lr_0 = 9.3359e-04
Validation auc = 0.645532
Epoch 1335
Validation auc = 0.645641
Epoch 1336
Validation auc = 0.646296
Epoch 1337
Validation auc = 0.644278
Epoch 1338
Validation auc = 0.640626
Epoch 1339
Loss = 1.9252e-03, PNorm = 126.9563, GNorm = 0.0501, lr_0 = 9.3336e-04
Loss = 1.5002e-04, PNorm = 126.9589, GNorm = 0.0075, lr_0 = 9.3334e-04
Validation auc = 0.638173
Epoch 1340
Validation auc = 0.638064
Epoch 1341
Validation auc = 0.637900
Epoch 1342
Validation auc = 0.638009
Epoch 1343
Validation auc = 0.636919
Epoch 1344
Loss = 1.9010e-04, PNorm = 126.9921, GNorm = 0.0041, lr_0 = 9.3312e-04
Validation auc = 0.638064
Epoch 1345
Validation auc = 0.638663
Epoch 1346
Validation auc = 0.640626
Epoch 1347
Validation auc = 0.640026
Epoch 1348
Validation auc = 0.636919
Epoch 1349
Loss = 2.3978e-04, PNorm = 127.0405, GNorm = 0.0052, lr_0 = 9.3288e-04
Validation auc = 0.634465
Epoch 1350
Validation auc = 0.633702
Epoch 1351
Validation auc = 0.632721
Epoch 1352
Validation auc = 0.631958
Epoch 1353
Loss = 2.9609e-03, PNorm = 127.0661, GNorm = 0.0736, lr_0 = 9.3266e-04
Loss = 9.9644e-04, PNorm = 127.0693, GNorm = 0.0354, lr_0 = 9.3264e-04
Validation auc = 0.632339
Epoch 1354
Validation auc = 0.631576
Epoch 1355
Validation auc = 0.633593
Epoch 1356
Validation auc = 0.634520
Epoch 1357
Validation auc = 0.635556
Epoch 1358
Loss = 3.8604e-04, PNorm = 127.1118, GNorm = 0.0068, lr_0 = 9.3241e-04
Validation auc = 0.636210
Epoch 1359
Validation auc = 0.637300
Epoch 1360
Validation auc = 0.637300
Epoch 1361
Validation auc = 0.637409
Epoch 1362
Validation auc = 0.638064
Epoch 1363
Loss = 1.9842e-03, PNorm = 127.1291, GNorm = 0.1037, lr_0 = 9.3218e-04
Validation auc = 0.639426
Epoch 1364
Validation auc = 0.641934
Epoch 1365
Validation auc = 0.643406
Epoch 1366
Validation auc = 0.644551
Epoch 1367
Loss = 5.7835e-04, PNorm = 127.1425, GNorm = 0.0188, lr_0 = 9.3197e-04
Loss = 2.7941e-04, PNorm = 127.1435, GNorm = 0.0104, lr_0 = 9.3195e-04
Validation auc = 0.645478
Epoch 1368
Validation auc = 0.645696
Epoch 1369
Validation auc = 0.645968
Epoch 1370
Validation auc = 0.646296
Epoch 1371
Validation auc = 0.646677
Epoch 1372
Loss = 5.1856e-04, PNorm = 127.1550, GNorm = 0.0295, lr_0 = 9.3172e-04
Loss = 8.9312e-05, PNorm = 127.1557, GNorm = 0.0033, lr_0 = 9.3170e-04
Validation auc = 0.646623
Epoch 1373
Validation auc = 0.646786
Epoch 1374
Validation auc = 0.646950
Epoch 1375
Validation auc = 0.647059
Epoch 1376
Validation auc = 0.647277
Epoch 1377
Loss = 2.6320e-04, PNorm = 127.1618, GNorm = 0.0050, lr_0 = 9.3149e-04
Validation auc = 0.647331
Epoch 1378
Validation auc = 0.647277
Epoch 1379
Validation auc = 0.647386
Epoch 1380
Validation auc = 0.647440
Epoch 1381
Validation auc = 0.650330
Epoch 1382
Loss = 1.1653e-01, PNorm = 127.1783, GNorm = 1.5356, lr_0 = 9.3124e-04
Validation auc = 0.647113
Epoch 1383
Validation auc = 0.640898
Epoch 1384
Validation auc = 0.638009
Epoch 1385
Validation auc = 0.634956
Epoch 1386
Loss = 6.2740e-03, PNorm = 127.2243, GNorm = 0.0012, lr_0 = 9.3102e-04
Loss = 4.8454e-05, PNorm = 127.2275, GNorm = 0.0020, lr_0 = 9.3101e-04
Validation auc = 0.632339
Epoch 1387
Validation auc = 0.632394
Epoch 1388
Validation auc = 0.633975
Epoch 1389
Validation auc = 0.637028
Epoch 1390
Validation auc = 0.642425
Epoch 1391
Loss = 2.3841e-03, PNorm = 127.2600, GNorm = 0.0727, lr_0 = 9.3078e-04
Validation auc = 0.644769
Epoch 1392
Validation auc = 0.647059
Epoch 1393
Validation auc = 0.649621
Epoch 1394
Validation auc = 0.651257
Epoch 1395
Validation auc = 0.651202
Epoch 1396
Loss = 8.2640e-04, PNorm = 127.2825, GNorm = 0.0291, lr_0 = 9.3055e-04
Validation auc = 0.650493
Epoch 1397
Validation auc = 0.650548
Epoch 1398
Validation auc = 0.650221
Epoch 1399
Validation auc = 0.650275
Epoch 1400
Loss = 3.7321e-04, PNorm = 127.3006, GNorm = 0.0133, lr_0 = 9.3033e-04
Loss = 9.7751e-06, PNorm = 127.3016, GNorm = 0.0004, lr_0 = 9.3032e-04
Validation auc = 0.650112
Epoch 1401
Validation auc = 0.649458
Epoch 1402
Validation auc = 0.649076
Epoch 1403
Validation auc = 0.649076
Epoch 1404
Validation auc = 0.649185
Epoch 1405
Loss = 5.2043e-04, PNorm = 127.3103, GNorm = 0.0025, lr_0 = 9.3008e-04
Loss = 1.6629e-05, PNorm = 127.3107, GNorm = 0.0008, lr_0 = 9.3007e-04
Validation auc = 0.649021
Epoch 1406
Validation auc = 0.649458
Epoch 1407
Validation auc = 0.647549
Epoch 1408
Validation auc = 0.646405
Epoch 1409
Validation auc = 0.646296
Epoch 1410
Loss = 1.5974e-04, PNorm = 127.3226, GNorm = 0.0038, lr_0 = 9.2985e-04
Validation auc = 0.646241
Epoch 1411
Validation auc = 0.646078
Epoch 1412
Validation auc = 0.645859
Epoch 1413
Validation auc = 0.645696
Epoch 1414
Validation auc = 0.645696
Epoch 1415
Loss = 3.6222e-04, PNorm = 127.3362, GNorm = 0.0058, lr_0 = 9.2961e-04
Validation auc = 0.645423
Epoch 1416
Validation auc = 0.646568
Epoch 1417
Validation auc = 0.649730
Epoch 1418
Validation auc = 0.648531
Epoch 1419
Loss = 6.8407e-03, PNorm = 127.3514, GNorm = 0.0078, lr_0 = 9.2939e-04
Loss = 9.6749e-05, PNorm = 127.3544, GNorm = 0.0034, lr_0 = 9.2938e-04
Validation auc = 0.643243
Epoch 1420
Validation auc = 0.639917
Epoch 1421
Validation auc = 0.638391
Epoch 1422
Validation auc = 0.636864
Epoch 1423
Validation auc = 0.635665
Epoch 1424
Loss = 2.5910e-04, PNorm = 127.3872, GNorm = 0.0037, lr_0 = 9.2914e-04
Validation auc = 0.634847
Epoch 1425
Validation auc = 0.634629
Epoch 1426
Validation auc = 0.634247
Epoch 1427
Validation auc = 0.634247
Epoch 1428
Validation auc = 0.634193
Epoch 1429
Loss = 2.1542e-04, PNorm = 127.4008, GNorm = 0.0032, lr_0 = 9.2891e-04
Validation auc = 0.634084
Epoch 1430
Validation auc = 0.634084
Epoch 1431
Validation auc = 0.634084
Epoch 1432
Validation auc = 0.634247
Epoch 1433
Loss = 3.2963e-04, PNorm = 127.4067, GNorm = 0.0026, lr_0 = 9.2868e-04
Validation auc = 0.634193
Epoch 1434
Validation auc = 0.634247
Epoch 1435
Validation auc = 0.634520
Epoch 1436
Validation auc = 0.635229
Epoch 1437
Validation auc = 0.635338
Epoch 1438
Loss = 1.1043e-04, PNorm = 127.4093, GNorm = 0.0019, lr_0 = 9.2845e-04
Loss = 2.2232e-05, PNorm = 127.4095, GNorm = 0.0011, lr_0 = 9.2844e-04
Validation auc = 0.635719
Epoch 1439
Validation auc = 0.636101
Epoch 1440
Validation auc = 0.635992
Epoch 1441
Validation auc = 0.635774
Epoch 1442
Validation auc = 0.635883
Epoch 1443
Loss = 7.3209e-05, PNorm = 127.4128, GNorm = 0.0015, lr_0 = 9.2822e-04
Validation auc = 0.635992
Epoch 1444
Validation auc = 0.635610
Epoch 1445
Validation auc = 0.635937
Epoch 1446
Validation auc = 0.635937
Epoch 1447
Validation auc = 0.635828
Epoch 1448
Loss = 1.7860e-04, PNorm = 127.4168, GNorm = 0.0026, lr_0 = 9.2798e-04
Validation auc = 0.635719
Epoch 1449
Validation auc = 0.635883
Epoch 1450
Validation auc = 0.635992
Epoch 1451
Validation auc = 0.636210
Epoch 1452
Loss = 1.9064e-04, PNorm = 127.4198, GNorm = 0.0022, lr_0 = 9.2776e-04
Loss = 3.6859e-04, PNorm = 127.4200, GNorm = 0.0204, lr_0 = 9.2775e-04
Validation auc = 0.636155
Epoch 1453
Validation auc = 0.636210
Epoch 1454
Validation auc = 0.636265
Epoch 1455
Validation auc = 0.636374
Epoch 1456
Validation auc = 0.636319
Epoch 1457
Loss = 8.9055e-05, PNorm = 127.4229, GNorm = 0.0010, lr_0 = 9.2752e-04
Loss = 1.0451e-04, PNorm = 127.4231, GNorm = 0.0028, lr_0 = 9.2750e-04
Validation auc = 0.636210
Epoch 1458
Validation auc = 0.636265
Epoch 1459
Validation auc = 0.636046
Epoch 1460
Validation auc = 0.636210
Epoch 1461
Validation auc = 0.637191
Epoch 1462
Loss = 1.3426e-03, PNorm = 127.4451, GNorm = 0.0667, lr_0 = 9.2729e-04
Validation auc = 0.640844
Epoch 1463
Validation auc = 0.642425
Epoch 1464
Validation auc = 0.643897
Epoch 1465
Validation auc = 0.644388
Epoch 1466
Loss = 2.6750e-02, PNorm = 127.4749, GNorm = 0.0073, lr_0 = 9.2706e-04
Validation auc = 0.643624
Epoch 1467
Validation auc = 0.642807
Epoch 1468
Validation auc = 0.642861
Epoch 1469
Validation auc = 0.642152
Epoch 1470
Validation auc = 0.641607
Epoch 1471
Loss = 5.3028e-04, PNorm = 127.4864, GNorm = 0.0139, lr_0 = 9.2683e-04
Loss = 3.4194e-04, PNorm = 127.4872, GNorm = 0.0137, lr_0 = 9.2681e-04
Validation auc = 0.641226
Epoch 1472
Validation auc = 0.640735
Epoch 1473
Validation auc = 0.640626
Epoch 1474
Validation auc = 0.640408
Epoch 1475
Validation auc = 0.640462
Epoch 1476
Loss = 3.3144e-02, PNorm = 127.4977, GNorm = 0.5725, lr_0 = 9.2660e-04
Validation auc = 0.642807
Epoch 1477
Validation auc = 0.639208
Epoch 1478
Validation auc = 0.638009
Epoch 1479
Validation auc = 0.636973
Epoch 1480
Validation auc = 0.636155
Epoch 1481
Loss = 3.2937e-03, PNorm = 127.5188, GNorm = 0.0845, lr_0 = 9.2635e-04
Validation auc = 0.634411
Epoch 1482
Validation auc = 0.632721
Epoch 1483
Validation auc = 0.632448
Epoch 1484
Validation auc = 0.631631
Epoch 1485
Loss = 5.3001e-04, PNorm = 127.5357, GNorm = 0.0028, lr_0 = 9.2614e-04
Loss = 3.2762e-04, PNorm = 127.5367, GNorm = 0.0114, lr_0 = 9.2612e-04
Validation auc = 0.632230
Epoch 1486
Validation auc = 0.632176
Epoch 1487
Validation auc = 0.632067
Epoch 1488
Validation auc = 0.632012
Epoch 1489
Validation auc = 0.632067
Epoch 1490
Loss = 1.6295e-04, PNorm = 127.5469, GNorm = 0.0046, lr_0 = 9.2589e-04
Loss = 5.2111e-05, PNorm = 127.5474, GNorm = 0.0030, lr_0 = 9.2587e-04
Validation auc = 0.632339
Epoch 1491
Validation auc = 0.632339
Epoch 1492
Validation auc = 0.632285
Epoch 1493
Validation auc = 0.632339
Epoch 1494
Validation auc = 0.632121
Epoch 1495
Loss = 5.2296e-05, PNorm = 127.5509, GNorm = 0.0010, lr_0 = 9.2566e-04
Validation auc = 0.632176
Epoch 1496
Validation auc = 0.632612
Epoch 1497
Validation auc = 0.632612
Epoch 1498
Validation auc = 0.632939
Epoch 1499
Loss = 6.9926e-04, PNorm = 127.5505, GNorm = 0.0382, lr_0 = 9.2543e-04
Validation auc = 0.632830
Epoch 1500
Validation auc = 0.633048
Epoch 1501
Validation auc = 0.632994
Epoch 1502
Validation auc = 0.633321
Epoch 1503
Validation auc = 0.633539
Epoch 1504
Loss = 3.4494e-04, PNorm = 127.5541, GNorm = 0.0058, lr_0 = 9.2520e-04
Loss = 1.1108e-04, PNorm = 127.5545, GNorm = 0.0036, lr_0 = 9.2518e-04
Validation auc = 0.633757
Epoch 1505
Validation auc = 0.633702
Epoch 1506
Validation auc = 0.633811
Epoch 1507
Validation auc = 0.633920
Epoch 1508
Validation auc = 0.633920
Epoch 1509
Loss = 4.8414e-05, PNorm = 127.5587, GNorm = 0.0010, lr_0 = 9.2497e-04
Validation auc = 0.633975
Epoch 1510
Validation auc = 0.633975
Epoch 1511
Validation auc = 0.634356
Epoch 1512
Validation auc = 0.633920
Epoch 1513
Validation auc = 0.634247
Epoch 1514
Loss = 1.2059e-04, PNorm = 127.5639, GNorm = 0.0020, lr_0 = 9.2472e-04
Validation auc = 0.634356
Epoch 1515
Validation auc = 0.634902
Epoch 1516
Validation auc = 0.634956
Epoch 1517
Validation auc = 0.634902
Epoch 1518
Loss = 1.0242e-04, PNorm = 127.5680, GNorm = 0.0008, lr_0 = 9.2451e-04
Loss = 1.5054e-04, PNorm = 127.5683, GNorm = 0.0050, lr_0 = 9.2449e-04
Validation auc = 0.634902
Epoch 1519
Validation auc = 0.635011
Epoch 1520
Validation auc = 0.635120
Epoch 1521
Validation auc = 0.635120
Epoch 1522
Validation auc = 0.632176
Epoch 1523
Loss = 3.4300e-04, PNorm = 127.5623, GNorm = 0.0025, lr_0 = 9.2427e-04
Loss = 2.4875e-04, PNorm = 127.5621, GNorm = 0.0078, lr_0 = 9.2425e-04
Validation auc = 0.630813
Epoch 1524
Validation auc = 0.631085
Epoch 1525
Validation auc = 0.630704
Epoch 1526
Validation auc = 0.631085
Epoch 1527
Validation auc = 0.630758
Epoch 1528
Loss = 6.1128e-04, PNorm = 127.5786, GNorm = 0.0127, lr_0 = 9.2404e-04
Validation auc = 0.630050
Epoch 1529
Validation auc = 0.629886
Epoch 1530
Validation auc = 0.630322
Epoch 1531
Validation auc = 0.630104
Epoch 1532
Validation auc = 0.630322
Epoch 1533
Loss = 6.8500e-05, PNorm = 127.5919, GNorm = 0.0011, lr_0 = 9.2379e-04
Validation auc = 0.630213
Epoch 1534
Validation auc = 0.629504
Epoch 1535
Validation auc = 0.629613
Epoch 1536
Validation auc = 0.629941
Epoch 1537
Loss = 1.2462e-04, PNorm = 127.5994, GNorm = 0.0021, lr_0 = 9.2358e-04
Loss = 8.2452e-06, PNorm = 127.5999, GNorm = 0.0003, lr_0 = 9.2356e-04
Validation auc = 0.629723
Epoch 1538
Validation auc = 0.629777
Epoch 1539
Validation auc = 0.630050
Epoch 1540
Validation auc = 0.630377
Epoch 1541
Validation auc = 0.630268
Epoch 1542
Loss = 1.0493e-04, PNorm = 127.6028, GNorm = 0.0018, lr_0 = 9.2335e-04
Validation auc = 0.630486
Epoch 1543
Validation auc = 0.630595
Epoch 1544
Validation auc = 0.630595
Epoch 1545
Validation auc = 0.630704
Epoch 1546
Validation auc = 0.630758
Epoch 1547
Loss = 1.6807e-04, PNorm = 127.6044, GNorm = 0.0025, lr_0 = 9.2310e-04
Validation auc = 0.630540
Epoch 1548
Validation auc = 0.630595
Epoch 1549
Validation auc = 0.630976
Epoch 1550
Validation auc = 0.631249
Epoch 1551
Loss = 1.2612e-04, PNorm = 127.6071, GNorm = 0.0016, lr_0 = 9.2289e-04
Loss = 2.9364e-05, PNorm = 127.6073, GNorm = 0.0012, lr_0 = 9.2287e-04
Validation auc = 0.631194
Epoch 1552
Validation auc = 0.631249
Epoch 1553
Validation auc = 0.631249
Epoch 1554
Validation auc = 0.631085
Epoch 1555
Validation auc = 0.630268
Epoch 1556
Loss = 5.2599e-04, PNorm = 127.6100, GNorm = 0.0177, lr_0 = 9.2264e-04
Loss = 6.5921e-04, PNorm = 127.6103, GNorm = 0.0126, lr_0 = 9.2263e-04
Validation auc = 0.630050
Epoch 1557
Validation auc = 0.629995
Epoch 1558
Validation auc = 0.629832
Epoch 1559
Validation auc = 0.630159
Epoch 1560
Validation auc = 0.630159
Epoch 1561
Loss = 7.4887e-05, PNorm = 127.6145, GNorm = 0.0019, lr_0 = 9.2242e-04
Validation auc = 0.630159
Epoch 1562
Validation auc = 0.630159
Epoch 1563
Validation auc = 0.630268
Epoch 1564
Validation auc = 0.630486
Epoch 1565
Validation auc = 0.630431
Epoch 1566
Loss = 1.0107e-04, PNorm = 127.6210, GNorm = 0.0015, lr_0 = 9.2217e-04
Validation auc = 0.630649
Epoch 1567
Validation auc = 0.630704
Epoch 1568
Validation auc = 0.630595
Epoch 1569
Validation auc = 0.630513
Epoch 1570
Loss = 2.1249e-04, PNorm = 127.6247, GNorm = 0.0010, lr_0 = 9.2196e-04
Loss = 2.1855e-07, PNorm = 127.6250, GNorm = 0.0000, lr_0 = 9.2194e-04
Validation auc = 0.630322
Epoch 1571
Validation auc = 0.629777
Epoch 1572
Validation auc = 0.629504
Epoch 1573
Validation auc = 0.629068
Epoch 1574
Validation auc = 0.629014
Epoch 1575
Loss = 1.2203e-04, PNorm = 127.6279, GNorm = 0.0018, lr_0 = 9.2173e-04
Validation auc = 0.628632
Epoch 1576
Validation auc = 0.628469
Epoch 1577
Validation auc = 0.628605
Epoch 1578
Validation auc = 0.628469
Epoch 1579
Validation auc = 0.628687
Epoch 1580
Loss = 5.1072e-05, PNorm = 127.6307, GNorm = 0.0010, lr_0 = 9.2148e-04
Validation auc = 0.628850
Epoch 1581
Validation auc = 0.629014
Epoch 1582
Validation auc = 0.628905
Epoch 1583
Validation auc = 0.629014
Epoch 1584
Loss = 4.9352e-05, PNorm = 127.6337, GNorm = 0.0005, lr_0 = 9.2127e-04
Loss = 1.5100e-06, PNorm = 127.6339, GNorm = 0.0001, lr_0 = 9.2125e-04
Validation auc = 0.629177
Epoch 1585
Validation auc = 0.629395
Epoch 1586
Validation auc = 0.629668
Epoch 1587
Validation auc = 0.629613
Epoch 1588
Validation auc = 0.629559
Epoch 1589
Loss = 6.4214e-05, PNorm = 127.6361, GNorm = 0.0012, lr_0 = 9.2103e-04
Loss = 1.3331e-05, PNorm = 127.6362, GNorm = 0.0006, lr_0 = 9.2101e-04
Validation auc = 0.629559
Epoch 1590
Validation auc = 0.629559
Epoch 1591
Validation auc = 0.629668
Epoch 1592
Validation auc = 0.629668
Epoch 1593
Validation auc = 0.629613
Epoch 1594
Loss = 3.0224e-05, PNorm = 127.6381, GNorm = 0.0009, lr_0 = 9.2080e-04
Validation auc = 0.629504
Epoch 1595
Validation auc = 0.629286
Epoch 1596
Validation auc = 0.629232
Epoch 1597
Validation auc = 0.629286
Epoch 1598
Validation auc = 0.629777
Epoch 1599
Loss = 3.7822e-05, PNorm = 127.6403, GNorm = 0.0006, lr_0 = 9.2055e-04
Validation auc = 0.629886
Epoch 1600
Validation auc = 0.630377
Epoch 1601
Validation auc = 0.630486
Epoch 1602
Validation auc = 0.630649
Epoch 1603
Loss = 6.9471e-05, PNorm = 127.6417, GNorm = 0.0018, lr_0 = 9.2034e-04
Loss = 4.3810e-04, PNorm = 127.6419, GNorm = 0.0199, lr_0 = 9.2032e-04
Validation auc = 0.630758
Epoch 1604
Validation auc = 0.631031
Epoch 1605
Validation auc = 0.631194
Epoch 1606
Validation auc = 0.631194
Epoch 1607
Validation auc = 0.631194
Epoch 1608
Loss = 7.0465e-05, PNorm = 127.6450, GNorm = 0.0005, lr_0 = 9.2010e-04
Validation auc = 0.631194
Epoch 1609
Validation auc = 0.631303
Epoch 1610
Validation auc = 0.631303
Epoch 1611
Validation auc = 0.631413
Epoch 1612
Validation auc = 0.631358
Epoch 1613
Loss = 4.2756e-05, PNorm = 127.6471, GNorm = 0.0008, lr_0 = 9.1987e-04
Validation auc = 0.631358
Epoch 1614
Validation auc = 0.631358
Epoch 1615
Validation auc = 0.631303
Epoch 1616
Validation auc = 0.631031
Epoch 1617
Loss = 6.1032e-05, PNorm = 127.6488, GNorm = 0.0027, lr_0 = 9.1966e-04
Loss = 1.6172e-05, PNorm = 127.6490, GNorm = 0.0006, lr_0 = 9.1964e-04
Validation auc = 0.631140
Epoch 1618
Validation auc = 0.631085
Epoch 1619
Validation auc = 0.631085
Epoch 1620
Validation auc = 0.631031
Epoch 1621
Validation auc = 0.631031
Epoch 1622
Loss = 1.2917e-04, PNorm = 127.6506, GNorm = 0.0112, lr_0 = 9.1941e-04
Loss = 1.7683e-06, PNorm = 127.6508, GNorm = 0.0001, lr_0 = 9.1939e-04
Validation auc = 0.630922
Epoch 1623
Validation auc = 0.631031
Epoch 1624
Validation auc = 0.631358
Epoch 1625
Validation auc = 0.631576
Epoch 1626
Validation auc = 0.631631
Epoch 1627
Loss = 5.4452e-05, PNorm = 127.6531, GNorm = 0.0010, lr_0 = 9.1918e-04
Validation auc = 0.634247
Epoch 1628
Validation auc = 0.625579
Epoch 1629
Validation auc = 0.615712
Epoch 1630
Validation auc = 0.611841
Epoch 1631
Validation auc = 0.608461
Epoch 1632
Loss = 4.4230e-04, PNorm = 127.6711, GNorm = 0.0255, lr_0 = 9.1894e-04
Validation auc = 0.606607
Epoch 1633
Validation auc = 0.605790
Epoch 1634
Validation auc = 0.604917
Epoch 1635
Validation auc = 0.604045
Epoch 1636
Loss = 2.3781e-04, PNorm = 127.6926, GNorm = 0.0140, lr_0 = 9.1873e-04
Loss = 2.2073e-05, PNorm = 127.6937, GNorm = 0.0013, lr_0 = 9.1871e-04
Validation auc = 0.603664
Epoch 1637
Validation auc = 0.603718
Epoch 1638
Validation auc = 0.604045
Epoch 1639
Validation auc = 0.604699
Epoch 1640
Validation auc = 0.605026
Epoch 1641
Loss = 1.6958e-04, PNorm = 127.7047, GNorm = 0.0062, lr_0 = 9.1848e-04
Validation auc = 0.605517
Epoch 1642
Validation auc = 0.605953
Epoch 1643
Validation auc = 0.605408
Epoch 1644
Validation auc = 0.599793
Epoch 1645
Validation auc = 0.593632
Epoch 1646
Loss = 4.0191e-04, PNorm = 127.7179, GNorm = 0.0116, lr_0 = 9.1825e-04
Validation auc = 0.588072
Epoch 1647
Validation auc = 0.583274
Epoch 1648
Validation auc = 0.579676
Epoch 1649
Validation auc = 0.578531
Epoch 1650
Loss = 7.5789e-04, PNorm = 127.7580, GNorm = 0.0340, lr_0 = 9.1804e-04
Loss = 3.2541e-05, PNorm = 127.7605, GNorm = 0.0018, lr_0 = 9.1803e-04
Validation auc = 0.577768
Epoch 1651
Validation auc = 0.577605
Epoch 1652
Validation auc = 0.577659
Epoch 1653
Validation auc = 0.578150
Epoch 1654
Validation auc = 0.579894
Epoch 1655
Loss = 1.5084e-04, PNorm = 127.7851, GNorm = 0.0040, lr_0 = 9.1780e-04
Loss = 3.1430e-05, PNorm = 127.7862, GNorm = 0.0010, lr_0 = 9.1778e-04
Validation auc = 0.580603
Epoch 1656
Validation auc = 0.581203
Epoch 1657
Validation auc = 0.581584
Epoch 1658
Validation auc = 0.580712
Epoch 1659
Validation auc = 0.580439
Epoch 1660
Loss = 1.1531e-04, PNorm = 127.7949, GNorm = 0.0030, lr_0 = 9.1757e-04
Validation auc = 0.580003
Epoch 1661
Validation auc = 0.579949
Epoch 1662
Validation auc = 0.579186
Epoch 1663
Validation auc = 0.579567
Epoch 1664
Validation auc = 0.578804
Epoch 1665
Loss = 1.5773e-04, PNorm = 127.7996, GNorm = 0.0046, lr_0 = 9.1733e-04
Validation auc = 0.578531
Epoch 1666
Validation auc = 0.578586
Epoch 1667
Validation auc = 0.578422
Epoch 1668
Validation auc = 0.578640
Epoch 1669
Loss = 8.0702e-05, PNorm = 127.8034, GNorm = 0.0023, lr_0 = 9.1712e-04
Loss = 7.5987e-05, PNorm = 127.8037, GNorm = 0.0032, lr_0 = 9.1710e-04
Validation auc = 0.578531
Epoch 1670
Validation auc = 0.578695
Epoch 1671
Validation auc = 0.579131
Epoch 1672
Validation auc = 0.573080
Epoch 1673
Validation auc = 0.570626
Epoch 1674
Loss = 2.1136e-04, PNorm = 127.8327, GNorm = 0.0050, lr_0 = 9.1687e-04
Validation auc = 0.570844
Epoch 1675
Validation auc = 0.569100
Epoch 1676
Validation auc = 0.567682
Epoch 1677
Validation auc = 0.567083
Epoch 1678
Validation auc = 0.566265
Epoch 1679
Loss = 7.6517e-04, PNorm = 127.9114, GNorm = 0.0379, lr_0 = 9.1664e-04
Validation auc = 0.565447
Epoch 1680
Validation auc = 0.562612
Epoch 1681
Validation auc = 0.559232
Epoch 1682
Validation auc = 0.556670
Epoch 1683
Loss = 3.1873e-04, PNorm = 127.9628, GNorm = 0.0121, lr_0 = 9.1642e-04
Validation auc = 0.555307
Epoch 1684
Validation auc = 0.554271
Epoch 1685
Validation auc = 0.552254
Epoch 1686
Validation auc = 0.548711
Epoch 1687
Validation auc = 0.540152
Epoch 1688
Loss = 1.3798e-01, PNorm = 128.0985, GNorm = 0.1006, lr_0 = 9.1619e-04
Loss = 1.1276e-03, PNorm = 128.1246, GNorm = 0.0459, lr_0 = 9.1617e-04
Validation auc = 0.520853
Epoch 1689
Validation auc = 0.513929
Epoch 1690
Validation auc = 0.522706
Epoch 1691
Validation auc = 0.537862
Epoch 1692
Validation auc = 0.542223
Epoch 1693
Loss = 2.5288e-02, PNorm = 128.4115, GNorm = 0.6395, lr_0 = 9.1596e-04
Validation auc = 0.559887
Epoch 1694
Validation auc = 0.580003
Epoch 1695
Validation auc = 0.585455
Epoch 1696
Validation auc = 0.595922
Epoch 1697
Validation auc = 0.610805
Epoch 1698
Loss = 3.0872e-04, PNorm = 128.7148, GNorm = 0.0114, lr_0 = 9.1572e-04
Validation auc = 0.622472
Epoch 1699
Validation auc = 0.610096
Epoch 1700
Validation auc = 0.605790
Epoch 1701
Validation auc = 0.605844
Epoch 1702
Loss = 1.0613e-01, PNorm = 129.0786, GNorm = 6.7286, lr_0 = 9.1551e-04
Loss = 8.6723e-05, PNorm = 129.1121, GNorm = 0.0042, lr_0 = 9.1549e-04
Validation auc = 0.616093
Epoch 1703
Validation auc = 0.612223
Epoch 1704
Validation auc = 0.605245
Epoch 1705
Validation auc = 0.602301
Epoch 1706
Validation auc = 0.606825
Epoch 1707
Loss = 1.4966e-02, PNorm = 129.5482, GNorm = 0.4582, lr_0 = 9.1526e-04
Loss = 1.0860e-03, PNorm = 129.5715, GNorm = 0.0534, lr_0 = 9.1525e-04
Validation auc = 0.604100
Epoch 1708
Validation auc = 0.595486
Epoch 1709
Validation auc = 0.591016
Epoch 1710
Validation auc = 0.581530
Epoch 1711
Validation auc = 0.574879
Epoch 1712
Loss = 2.8902e-03, PNorm = 129.7784, GNorm = 0.1226, lr_0 = 9.1504e-04
Validation auc = 0.571390
Epoch 1713
Validation auc = 0.570517
Epoch 1714
Validation auc = 0.572916
Epoch 1715
Validation auc = 0.575206
Epoch 1716
Loss = 2.3476e-03, PNorm = 129.8534, GNorm = 0.0242, lr_0 = 9.1481e-04
Validation auc = 0.579186
Epoch 1717
Validation auc = 0.583383
Epoch 1718
Validation auc = 0.583438
Epoch 1719
Validation auc = 0.585782
Epoch 1720
Validation auc = 0.585073
Epoch 1721
Loss = 9.7639e-04, PNorm = 129.8925, GNorm = 0.0202, lr_0 = 9.1458e-04
Loss = 7.4352e-04, PNorm = 129.8947, GNorm = 0.0265, lr_0 = 9.1457e-04
Validation auc = 0.582620
Epoch 1722
Validation auc = 0.581748
Epoch 1723
Validation auc = 0.580657
Epoch 1724
Validation auc = 0.581257
Epoch 1725
Validation auc = 0.581911
Epoch 1726
Loss = 2.5767e-03, PNorm = 129.9215, GNorm = 0.0784, lr_0 = 9.1436e-04
Validation auc = 0.582675
Epoch 1727
Validation auc = 0.584038
Epoch 1728
Validation auc = 0.584692
Epoch 1729
Validation auc = 0.582457
Epoch 1730
Validation auc = 0.586654
Epoch 1731
Loss = 4.0075e-02, PNorm = 129.9547, GNorm = 1.9685, lr_0 = 9.1411e-04
Validation auc = 0.602410
Epoch 1732
Validation auc = 0.611405
Epoch 1733
Validation auc = 0.621600
Epoch 1734
Validation auc = 0.657962
Epoch 1735
Loss = 7.9723e-02, PNorm = 130.2402, GNorm = 3.0046, lr_0 = 9.1390e-04
Loss = 3.0596e-01, PNorm = 130.2952, GNorm = 12.6582, lr_0 = 9.1389e-04
Validation auc = 0.640789
Epoch 1736
Validation auc = 0.627978
Epoch 1737
Validation auc = 0.605735
Epoch 1738
Validation auc = 0.609715
Epoch 1739
Validation auc = 0.631303
Epoch 1740
Loss = 2.0792e-02, PNorm = 131.2595, GNorm = 0.3489, lr_0 = 9.1366e-04
Loss = 4.7695e-03, PNorm = 131.3314, GNorm = 0.0963, lr_0 = 9.1364e-04
Validation auc = 0.649567
Epoch 1741
Validation auc = 0.649021
Epoch 1742
Validation auc = 0.650221
Epoch 1743
Validation auc = 0.645314
Epoch 1744
Validation auc = 0.641171
Epoch 1745
Loss = 3.9479e-02, PNorm = 132.1142, GNorm = 0.6748, lr_0 = 9.1343e-04
Validation auc = 0.637355
Epoch 1746
Validation auc = 0.621327
Epoch 1747
Validation auc = 0.605299
Epoch 1748
Validation auc = 0.578967
Epoch 1749
Loss = 1.2215e-01, PNorm = 132.6963, GNorm = 0.2943, lr_0 = 9.1320e-04
Validation auc = 0.598048
Epoch 1750
Validation auc = 0.625416
Epoch 1751
Validation auc = 0.645042
Epoch 1752
Validation auc = 0.663959
Epoch 1753
Validation auc = 0.656817
Epoch 1754
Loss = 5.3912e-03, PNorm = 133.0489, GNorm = 0.1993, lr_0 = 9.1298e-04
Loss = 5.0600e-01, PNorm = 133.0696, GNorm = 9.1039, lr_0 = 9.1296e-04
Validation auc = 0.636101
Epoch 1755
Validation auc = 0.592106
Epoch 1756
Validation auc = 0.559287
Epoch 1757
Validation auc = 0.603227
Epoch 1758
Validation auc = 0.696942
Epoch 1759
Loss = 1.2939e-01, PNorm = 133.6581, GNorm = 1.7256, lr_0 = 9.1275e-04
Validation auc = 0.705664
Epoch 1760
Validation auc = 0.707409
Epoch 1761
Validation auc = 0.722728
Epoch 1762
Validation auc = 0.747969
Epoch 1763
Validation auc = 0.753639
Epoch 1764
Loss = 4.6261e-02, PNorm = 134.4688, GNorm = 0.7183, lr_0 = 9.1251e-04
Validation auc = 0.745352
Epoch 1765
Validation auc = 0.741482
Epoch 1766
Validation auc = 0.733795
Epoch 1767
Validation auc = 0.722564
Epoch 1768
Loss = 8.2784e-03, PNorm = 134.8704, GNorm = 0.0859, lr_0 = 9.1230e-04
Loss = 4.2207e-03, PNorm = 134.8932, GNorm = 0.2423, lr_0 = 9.1228e-04
Validation auc = 0.695524
Epoch 1769
Validation auc = 0.666903
Epoch 1770
Validation auc = 0.652892
Epoch 1771
Validation auc = 0.662324
Epoch 1772
Validation auc = 0.683531
Epoch 1773
Loss = 8.5782e-02, PNorm = 135.2135, GNorm = 0.8293, lr_0 = 9.1206e-04
Loss = 1.1881e-03, PNorm = 135.2401, GNorm = 0.0805, lr_0 = 9.1204e-04
Validation auc = 0.697541
Epoch 1774
Validation auc = 0.703647
Epoch 1775
Validation auc = 0.704683
Epoch 1776
Validation auc = 0.709371
Epoch 1777
Validation auc = 0.709589
Epoch 1778
Loss = 2.8489e-02, PNorm = 135.4697, GNorm = 0.5470, lr_0 = 9.1183e-04
Validation auc = 0.705991
Epoch 1779
Validation auc = 0.704574
Epoch 1780
Validation auc = 0.701630
Epoch 1781
Validation auc = 0.700049
Epoch 1782
Validation auc = 0.698195
Epoch 1783
Loss = 4.2997e-04, PNorm = 135.6042, GNorm = 0.0105, lr_0 = 9.1159e-04
Validation auc = 0.697105
Epoch 1784
Validation auc = 0.695470
Epoch 1785
Validation auc = 0.685711
Epoch 1786
Validation auc = 0.679987
Epoch 1787
Loss = 1.4647e-03, PNorm = 135.6956, GNorm = 0.0194, lr_0 = 9.1138e-04
Loss = 1.7752e-02, PNorm = 135.7017, GNorm = 0.5792, lr_0 = 9.1136e-04
Validation auc = 0.676879
Epoch 1788
Validation auc = 0.675517
Epoch 1789
Validation auc = 0.674154
Epoch 1790
Validation auc = 0.662760
Epoch 1791
Validation auc = 0.668211
Epoch 1792
Loss = 8.9956e-04, PNorm = 135.8063, GNorm = 0.0229, lr_0 = 9.1115e-04
Validation auc = 0.675135
Epoch 1793
Validation auc = 0.676825
Epoch 1794
Validation auc = 0.652347
Epoch 1795
Validation auc = 0.638500
Epoch 1796
Validation auc = 0.631794
Epoch 1797
Loss = 8.9596e-02, PNorm = 136.7849, GNorm = 0.9643, lr_0 = 9.1091e-04
Validation auc = 0.638064
Epoch 1798
Validation auc = 0.619528
Epoch 1799
Validation auc = 0.609006
Epoch 1800
Validation auc = 0.592160
Epoch 1801
Loss = 4.4300e-02, PNorm = 137.6428, GNorm = 1.4786, lr_0 = 9.1070e-04
Loss = 3.7501e-04, PNorm = 137.6926, GNorm = 0.0175, lr_0 = 9.1068e-04
Validation auc = 0.608297
Epoch 1802
Validation auc = 0.624380
Epoch 1803
Validation auc = 0.636592
Epoch 1804
Validation auc = 0.628959
Epoch 1805
Validation auc = 0.619255
Epoch 1806
Loss = 8.6314e-02, PNorm = 138.2156, GNorm = 1.3056, lr_0 = 9.1046e-04
Loss = 1.0656e-01, PNorm = 138.2505, GNorm = 2.3497, lr_0 = 9.1044e-04
Validation auc = 0.611950
Epoch 1807
Validation auc = 0.600283
Epoch 1808
Validation auc = 0.596031
Epoch 1809
Validation auc = 0.592760
Epoch 1810
Validation auc = 0.613640
Epoch 1811
Loss = 7.3427e-02, PNorm = 138.6685, GNorm = 1.7668, lr_0 = 9.1023e-04
Validation auc = 0.620618
Epoch 1812
Validation auc = 0.618110
Epoch 1813
Validation auc = 0.646841
Epoch 1814
Validation auc = 0.668647
Epoch 1815
Validation auc = 0.677915
Epoch 1816
Loss = 2.7383e-02, PNorm = 139.1225, GNorm = 0.4901, lr_0 = 9.0999e-04
Validation auc = 0.672791
Epoch 1817
Validation auc = 0.669738
Epoch 1818
Validation auc = 0.668429
Epoch 1819
Validation auc = 0.662978
Epoch 1820
Loss = 5.4835e-02, PNorm = 139.4306, GNorm = 0.9562, lr_0 = 9.0978e-04
Loss = 2.9346e-02, PNorm = 139.4499, GNorm = 0.8830, lr_0 = 9.0976e-04
Validation auc = 0.657908
Epoch 1821
Validation auc = 0.653601
Epoch 1822
Validation auc = 0.648803
Epoch 1823
Validation auc = 0.643297
Epoch 1824
Validation auc = 0.643570
Epoch 1825
Loss = 6.3652e-03, PNorm = 139.6362, GNorm = 0.1541, lr_0 = 9.0955e-04
Validation auc = 0.645914
Epoch 1826
Validation auc = 0.647386
Epoch 1827
Validation auc = 0.649512
Epoch 1828
Validation auc = 0.649239
Epoch 1829
Validation auc = 0.646950
Epoch 1830
Loss = 7.6559e-04, PNorm = 139.7400, GNorm = 0.0109, lr_0 = 9.0931e-04
Validation auc = 0.643679
Epoch 1831
Validation auc = 0.627869
Epoch 1832
Validation auc = 0.653546
Epoch 1833
Validation auc = 0.694379
Epoch 1834
Loss = 2.2116e-01, PNorm = 139.9786, GNorm = 1.7550, lr_0 = 9.0910e-04
Loss = 3.4400e-01, PNorm = 140.0373, GNorm = 2.0647, lr_0 = 9.0909e-04
Validation auc = 0.671809
Epoch 1835
Validation auc = 0.671646
Epoch 1836
Validation auc = 0.658780
Epoch 1837
Validation auc = 0.645968
Epoch 1838
Validation auc = 0.633484
Epoch 1839
Loss = 1.0181e-01, PNorm = 140.8716, GNorm = 0.3416, lr_0 = 9.0886e-04
Loss = 9.7127e-04, PNorm = 140.9248, GNorm = 0.0209, lr_0 = 9.0884e-04
Validation auc = 0.601810
Epoch 1840
Validation auc = 0.593605
Epoch 1841
Validation auc = 0.612632
Epoch 1842
Validation auc = 0.625825
Epoch 1843
Validation auc = 0.629859
Epoch 1844
Loss = 5.7577e-02, PNorm = 141.4584, GNorm = 0.8764, lr_0 = 9.0863e-04
Validation auc = 0.622254
Epoch 1845
Validation auc = 0.624980
Epoch 1846
Validation auc = 0.624871
Epoch 1847
Validation auc = 0.628550
Epoch 1848
Validation auc = 0.633321
Epoch 1849
Loss = 1.8604e-02, PNorm = 141.8046, GNorm = 0.3219, lr_0 = 9.0839e-04
Validation auc = 0.636483
Epoch 1850
Validation auc = 0.640353
Epoch 1851
Validation auc = 0.641007
Epoch 1852
Validation auc = 0.644578
Epoch 1853
Loss = 8.1573e-03, PNorm = 141.9410, GNorm = 0.1000, lr_0 = 9.0818e-04
Loss = 2.6710e-04, PNorm = 141.9504, GNorm = 0.0141, lr_0 = 9.0817e-04
Validation auc = 0.644060
Epoch 1854
Validation auc = 0.642561
Epoch 1855
Validation auc = 0.637982
Epoch 1856
Validation auc = 0.633157
Epoch 1857
Validation auc = 0.630949
Epoch 1858
Loss = 2.6156e-02, PNorm = 142.0332, GNorm = 0.8452, lr_0 = 9.0794e-04
Validation auc = 0.623780
Epoch 1859
Validation auc = 0.618492
Epoch 1860
Validation auc = 0.617674
Epoch 1861
Validation auc = 0.614730
Epoch 1862
Validation auc = 0.612359
Epoch 1863
Loss = 9.0102e-04, PNorm = 142.0984, GNorm = 0.0169, lr_0 = 9.0772e-04
Validation auc = 0.610805
Epoch 1864
Validation auc = 0.610642
Epoch 1865
Validation auc = 0.612904
Epoch 1866
Validation auc = 0.618192
Epoch 1867
Loss = 2.4504e-03, PNorm = 142.1412, GNorm = 0.0779, lr_0 = 9.0751e-04
Loss = 1.3286e-03, PNorm = 142.1441, GNorm = 0.0393, lr_0 = 9.0749e-04
Validation auc = 0.626370
Epoch 1868
Validation auc = 0.634493
Epoch 1869
Validation auc = 0.601565
Epoch 1870
Validation auc = 0.559178
Epoch 1871
Validation auc = 0.606825
Epoch 1872
Loss = 1.8679e-03, PNorm = 142.3113, GNorm = 0.0411, lr_0 = 9.0727e-04
Loss = 8.2254e-06, PNorm = 142.3317, GNorm = 0.0003, lr_0 = 9.0725e-04
Validation auc = 0.644660
Epoch 1873
Validation auc = 0.663468
Epoch 1874
Validation auc = 0.677043
Epoch 1875
Validation auc = 0.679660
Epoch 1876
Validation auc = 0.684348
Epoch 1877
Loss = 9.7228e-03, PNorm = 142.5424, GNorm = 0.2328, lr_0 = 9.0704e-04
Validation auc = 0.688928
Epoch 1878
Validation auc = 0.695034
Epoch 1879
Validation auc = 0.705555
Epoch 1880
Validation auc = 0.710625
Epoch 1881
Validation auc = 0.708717
Epoch 1882
Loss = 4.6609e-03, PNorm = 142.7078, GNorm = 0.0895, lr_0 = 9.0680e-04
Validation auc = 0.708608
Epoch 1883
Validation auc = 0.652510
Epoch 1884
Validation auc = 0.623671
Epoch 1885
Validation auc = 0.608406
Epoch 1886
Loss = 3.7960e-03, PNorm = 142.8308, GNorm = 0.1715, lr_0 = 9.0659e-04
Loss = 1.1242e-03, PNorm = 142.8422, GNorm = 0.0304, lr_0 = 9.0657e-04
Validation auc = 0.588889
Epoch 1887
Validation auc = 0.625143
Epoch 1888
Validation auc = 0.635828
Epoch 1889
Validation auc = 0.643624
Epoch 1890
Validation auc = 0.648912
Epoch 1891
Loss = 1.0247e-03, PNorm = 142.9497, GNorm = 0.0182, lr_0 = 9.0635e-04
Validation auc = 0.652510
Epoch 1892
Validation auc = 0.658616
Epoch 1893
Validation auc = 0.663741
Epoch 1894
Validation auc = 0.662433
Epoch 1895
Validation auc = 0.660797
Epoch 1896
Loss = 5.3860e-04, PNorm = 143.0103, GNorm = 0.0095, lr_0 = 9.0612e-04
Validation auc = 0.661560
Epoch 1897
Validation auc = 0.663414
Epoch 1898
Validation auc = 0.664886
Epoch 1899
Validation auc = 0.665758
Epoch 1900
Loss = 7.8972e-04, PNorm = 143.0390, GNorm = 0.0310, lr_0 = 9.0592e-04
Loss = 1.5402e-02, PNorm = 143.0409, GNorm = 0.5455, lr_0 = 9.0590e-04
Validation auc = 0.666903
Epoch 1901
Validation auc = 0.666794
Epoch 1902
Validation auc = 0.666412
Epoch 1903
Validation auc = 0.665267
Epoch 1904
Validation auc = 0.662978
Epoch 1905
Loss = 1.2001e-03, PNorm = 143.0666, GNorm = 0.0081, lr_0 = 9.0567e-04
Loss = 1.3758e-03, PNorm = 143.0682, GNorm = 0.0397, lr_0 = 9.0566e-04
Validation auc = 0.661179
Epoch 1906
Validation auc = 0.660252
Epoch 1907
Validation auc = 0.659380
Epoch 1908
Validation auc = 0.654528
Epoch 1909
Validation auc = 0.650439
Epoch 1910
Loss = 1.2267e-01, PNorm = 143.1365, GNorm = 0.8213, lr_0 = 9.0545e-04
Validation auc = 0.650493
Epoch 1911
Validation auc = 0.646187
Epoch 1912
Validation auc = 0.648585
Epoch 1913
Validation auc = 0.645532
Epoch 1914
Validation auc = 0.641007
Epoch 1915
Loss = 9.7236e-03, PNorm = 143.3410, GNorm = 0.2495, lr_0 = 9.0521e-04
Validation auc = 0.638173
Epoch 1916
Validation auc = 0.636210
Epoch 1917
Validation auc = 0.632994
Epoch 1918
Validation auc = 0.629504
Epoch 1919
Loss = 7.0663e-03, PNorm = 143.4764, GNorm = 0.1475, lr_0 = 9.0500e-04
Loss = 1.1781e-02, PNorm = 143.4848, GNorm = 0.4382, lr_0 = 9.0498e-04
Validation auc = 0.629723
Epoch 1920
Validation auc = 0.631467
Epoch 1921
Validation auc = 0.641444
Epoch 1922
Validation auc = 0.653655
Epoch 1923
Validation auc = 0.664668
Epoch 1924
Loss = 3.2815e-03, PNorm = 143.5609, GNorm = 0.0853, lr_0 = 9.0476e-04
Validation auc = 0.673118
Epoch 1925
Validation auc = 0.678188
Epoch 1926
Validation auc = 0.680750
Epoch 1927
Validation auc = 0.684730
Epoch 1928
Validation auc = 0.687783
Epoch 1929
Loss = 3.9765e-03, PNorm = 143.6042, GNorm = 0.1370, lr_0 = 9.0454e-04
Validation auc = 0.690018
Epoch 1930
Validation auc = 0.691108
Epoch 1931
Validation auc = 0.692417
Epoch 1932
Validation auc = 0.693234
Epoch 1933
Loss = 2.7660e-04, PNorm = 143.6242, GNorm = 0.0019, lr_0 = 9.0431e-04
Validation auc = 0.692962
Epoch 1934
Validation auc = 0.693125
Epoch 1935
Validation auc = 0.693289
Epoch 1936
Validation auc = 0.692253
Epoch 1937
Validation auc = 0.688110
Epoch 1938
Loss = 3.2282e-02, PNorm = 143.6348, GNorm = 2.4066, lr_0 = 9.0409e-04
Loss = 4.6548e-04, PNorm = 143.6353, GNorm = 0.0186, lr_0 = 9.0407e-04
Validation auc = 0.685766
Epoch 1939
Validation auc = 0.681295
Epoch 1940
Validation auc = 0.673445
Epoch 1941
Validation auc = 0.668593
Epoch 1942
Validation auc = 0.665431
Epoch 1943
Loss = 9.0488e-04, PNorm = 143.6590, GNorm = 0.0142, lr_0 = 9.0386e-04
Validation auc = 0.662923
Epoch 1944
Validation auc = 0.664177
Epoch 1945
Validation auc = 0.667557
Epoch 1946
Validation auc = 0.670010
Epoch 1947
Validation auc = 0.673390
Epoch 1948
Loss = 6.2084e-04, PNorm = 143.6837, GNorm = 0.0178, lr_0 = 9.0362e-04
Validation auc = 0.675353
Epoch 1949
Validation auc = 0.676607
Epoch 1950
Validation auc = 0.678024
Epoch 1951
Validation auc = 0.679333
Epoch 1952
Loss = 3.1785e-04, PNorm = 143.7022, GNorm = 0.0043, lr_0 = 9.0341e-04
Loss = 3.5763e-06, PNorm = 143.7035, GNorm = 0.0001, lr_0 = 9.0340e-04
Validation auc = 0.679714
Epoch 1953
Validation auc = 0.681295
Epoch 1954
Validation auc = 0.668266
Epoch 1955
Validation auc = 0.659979
Epoch 1956
Validation auc = 0.653492
Epoch 1957
Loss = 3.5484e-04, PNorm = 143.7220, GNorm = 0.0072, lr_0 = 9.0317e-04
Loss = 3.2364e-05, PNorm = 143.7231, GNorm = 0.0011, lr_0 = 9.0316e-04
Validation auc = 0.648640
Epoch 1958
Validation auc = 0.645478
Epoch 1959
Validation auc = 0.640735
Epoch 1960
Validation auc = 0.635665
Epoch 1961
Validation auc = 0.633212
Epoch 1962
Loss = 4.9743e-04, PNorm = 143.7380, GNorm = 0.0145, lr_0 = 9.0295e-04
Validation auc = 0.632994
Epoch 1963
Validation auc = 0.637191
Epoch 1964
Validation auc = 0.640135
Epoch 1965
Validation auc = 0.642534
Epoch 1966
Loss = 4.4638e-03, PNorm = 143.7475, GNorm = 0.0027, lr_0 = 9.0273e-04
Validation auc = 0.645532
Epoch 1967
Validation auc = 0.644824
Epoch 1968
Validation auc = 0.641880
Epoch 1969
Validation auc = 0.639372
Epoch 1970
Validation auc = 0.634684
Epoch 1971
Loss = 5.4911e-04, PNorm = 143.8544, GNorm = 0.0177, lr_0 = 9.0250e-04
Loss = 6.5859e-04, PNorm = 143.8616, GNorm = 0.0158, lr_0 = 9.0249e-04
Validation auc = 0.629232
Epoch 1972
Validation auc = 0.626724
Epoch 1973
Validation auc = 0.625634
Epoch 1974
Validation auc = 0.623998
Epoch 1975
Validation auc = 0.622635
Epoch 1976
Loss = 5.3324e-04, PNorm = 143.9207, GNorm = 0.0131, lr_0 = 9.0228e-04
Validation auc = 0.623344
Epoch 1977
Validation auc = 0.623290
Epoch 1978
Validation auc = 0.625906
Epoch 1979
Validation auc = 0.628469
Epoch 1980
Validation auc = 0.629559
Epoch 1981
Loss = 2.8568e-03, PNorm = 143.9647, GNorm = 0.0731, lr_0 = 9.0204e-04
Validation auc = 0.630758
Epoch 1982
Validation auc = 0.604018
Epoch 1983
Validation auc = 0.589271
Epoch 1984
Validation auc = 0.574770
Epoch 1985
Loss = 5.7108e-03, PNorm = 143.9986, GNorm = 0.0924, lr_0 = 9.0183e-04
Loss = 1.2404e-03, PNorm = 144.0013, GNorm = 0.0490, lr_0 = 9.0181e-04
Validation auc = 0.583111
Epoch 1986
Validation auc = 0.591016
Epoch 1987
Validation auc = 0.598321
Epoch 1988
Validation auc = 0.604481
Epoch 1989
Validation auc = 0.608025
Epoch 1990
Loss = 5.5575e-04, PNorm = 144.0418, GNorm = 0.0142, lr_0 = 9.0159e-04
Loss = 2.1989e-03, PNorm = 144.0437, GNorm = 0.0901, lr_0 = 9.0157e-04
Validation auc = 0.611241
Epoch 1991
Validation auc = 0.612550
Epoch 1992
Validation auc = 0.613531
Epoch 1993
Validation auc = 0.614131
Epoch 1994
Validation auc = 0.616039
Epoch 1995
Loss = 3.1574e-03, PNorm = 144.0629, GNorm = 0.0963, lr_0 = 9.0137e-04
Validation auc = 0.617947
Epoch 1996
Validation auc = 0.619419
Epoch 1997
Validation auc = 0.619991
Epoch 1998
Validation auc = 0.620727
Epoch 1999
Loss = 4.5071e-03, PNorm = 144.1118, GNorm = 0.1019, lr_0 = 9.0114e-04
Validation auc = 0.621136
Model 0 best validation auc = 0.753639 on epoch 1763
Loading pretrained parameter "encoder.encoder.0.cached_zero_vector".
Loading pretrained parameter "encoder.encoder.0.W_i.weight".
Loading pretrained parameter "encoder.encoder.0.W_h.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.bias".
Loading pretrained parameter "ffn.1.weight".
Loading pretrained parameter "ffn.1.bias".
Moving model to cuda
Model 0 test auc = 0.692327
Ensemble test auc = 0.692327
Fold 7
Splitting data with seed 7
Class sizes
sars_cov_two_active 0: 98.39%, 1: 1.61%
Total size = 3,294 | train size = 3,294 | val size = 1,096 | test size = 1,086
With class_balance, effective train size = 106
Building model 0
MoleculeModel(
  (sigmoid): Sigmoid()
  (encoder): MPN(
    (encoder): ModuleList(
      (0): MPNEncoder(
        (dropout_layer): Dropout(p=0.05, inplace=False)
        (act_func): ReLU()
        (W_i): Linear(in_features=147, out_features=2100, bias=False)
        (W_h): Linear(in_features=2100, out_features=2100, bias=False)
        (W_o): Linear(in_features=2233, out_features=2100, bias=True)
      )
    )
  )
  (ffn): Sequential(
    (0): Dropout(p=0.05, inplace=False)
    (1): Linear(in_features=2328, out_features=1, bias=True)
  )
)
Number of parameters = 9,412,429
Moving model to cuda
Epoch 0
Validation auc = 0.469225
Epoch 1
Validation auc = 0.592051
Epoch 2
Validation auc = 0.648422
Epoch 3
Validation auc = 0.626833
Epoch 4
Loss = 7.2359e-01, PNorm = 67.4123, GNorm = 1.1444, lr_0 = 2.0385e-04
Loss = 5.5706e-01, PNorm = 67.4146, GNorm = 2.8415, lr_0 = 2.1077e-04
Validation auc = 0.654255
Epoch 5
Validation auc = 0.660361
Epoch 6
Validation auc = 0.644769
Epoch 7
Validation auc = 0.683367
Epoch 8
Validation auc = 0.676770
Epoch 9
Loss = 6.7124e-01, PNorm = 67.4526, GNorm = 1.0764, lr_0 = 3.0077e-04
Validation auc = 0.674699
Epoch 10
Validation auc = 0.700812
Epoch 11
Validation auc = 0.711389
Epoch 12
Validation auc = 0.711879
Epoch 13
Validation auc = 0.695252
Epoch 14
Loss = 6.8906e-01, PNorm = 67.5182, GNorm = 0.7935, lr_0 = 4.0462e-04
Validation auc = 0.671918
Epoch 15
Validation auc = 0.663741
Epoch 16
Validation auc = 0.619146
Epoch 17
Validation auc = 0.608625
Epoch 18
Loss = 7.0751e-01, PNorm = 67.6018, GNorm = 2.0871, lr_0 = 4.9462e-04
Loss = 5.9987e-01, PNorm = 67.6113, GNorm = 1.5010, lr_0 = 5.0154e-04
Validation auc = 0.613477
Epoch 19
Validation auc = 0.599629
Epoch 20
Validation auc = 0.599411
Epoch 21
Validation auc = 0.613913
Epoch 22
Validation auc = 0.622417
Epoch 23
Loss = 6.1096e-01, PNorm = 67.7584, GNorm = 1.2145, lr_0 = 5.9846e-04
Loss = 6.5893e-01, PNorm = 67.7711, GNorm = 3.3787, lr_0 = 6.0538e-04
Validation auc = 0.668429
Epoch 24
Validation auc = 0.672464
Epoch 25
Validation auc = 0.667448
Epoch 26
Validation auc = 0.641280
Epoch 27
Validation auc = 0.624707
Epoch 28
Loss = 6.6316e-01, PNorm = 67.9826, GNorm = 1.0424, lr_0 = 6.9538e-04
Validation auc = 0.607807
Epoch 29
Validation auc = 0.610206
Epoch 30
Validation auc = 0.626342
Epoch 31
Validation auc = 0.671646
Epoch 32
Validation auc = 0.639863
Epoch 33
Loss = 5.7748e-01, PNorm = 68.2545, GNorm = 0.8882, lr_0 = 7.9923e-04
Validation auc = 0.640735
Epoch 34
Validation auc = 0.598157
Epoch 35
Validation auc = 0.541078
Epoch 36
Validation auc = 0.545058
Epoch 37
Loss = 6.7499e-01, PNorm = 68.5966, GNorm = 2.0111, lr_0 = 8.8923e-04
Loss = 6.1571e-01, PNorm = 68.6373, GNorm = 2.2813, lr_0 = 8.9615e-04
Validation auc = 0.549528
Epoch 38
Validation auc = 0.540915
Epoch 39
Validation auc = 0.551764
Epoch 40
Validation auc = 0.573080
Epoch 41
Validation auc = 0.596467
Epoch 42
Loss = 6.7896e-01, PNorm = 69.0817, GNorm = 0.7721, lr_0 = 9.8615e-04
Validation auc = 0.584474
Epoch 43
Validation auc = 0.588944
Epoch 44
Validation auc = 0.580494
Epoch 45
Validation auc = 0.602083
Epoch 46
Validation auc = 0.624489
Epoch 47
Loss = 6.9510e-01, PNorm = 69.3810, GNorm = 1.3809, lr_0 = 9.9977e-04
Validation auc = 0.629995
Epoch 48
Validation auc = 0.655291
Epoch 49
Validation auc = 0.661397
Epoch 50
Validation auc = 0.665922
Epoch 51
Loss = 6.3985e-01, PNorm = 69.5754, GNorm = 0.7746, lr_0 = 9.9954e-04
Loss = 5.9507e-01, PNorm = 69.5853, GNorm = 2.8260, lr_0 = 9.9952e-04
Validation auc = 0.666521
Epoch 52
Validation auc = 0.640517
Epoch 53
Validation auc = 0.594178
Epoch 54
Validation auc = 0.611787
Epoch 55
Validation auc = 0.624707
Epoch 56
Loss = 6.3335e-01, PNorm = 69.7803, GNorm = 1.1591, lr_0 = 9.9927e-04
Loss = 6.3048e-01, PNorm = 69.7883, GNorm = 3.1108, lr_0 = 9.9926e-04
Validation auc = 0.636919
Epoch 57
Validation auc = 0.634302
Epoch 58
Validation auc = 0.637736
Epoch 59
Validation auc = 0.643297
Epoch 60
Validation auc = 0.652947
Epoch 61
Loss = 6.4737e-01, PNorm = 69.9571, GNorm = 1.0023, lr_0 = 9.9903e-04
Validation auc = 0.650657
Epoch 62
Validation auc = 0.660361
Epoch 63
Validation auc = 0.657635
Epoch 64
Validation auc = 0.639154
Epoch 65
Validation auc = 0.629832
Epoch 66
Loss = 5.9451e-01, PNorm = 70.1869, GNorm = 0.7556, lr_0 = 9.9876e-04
Validation auc = 0.619037
Epoch 67
Validation auc = 0.603554
Epoch 68
Validation auc = 0.607861
Epoch 69
Validation auc = 0.616257
Epoch 70
Loss = 5.4436e-01, PNorm = 70.4219, GNorm = 0.8067, lr_0 = 9.9853e-04
Loss = 4.3871e-01, PNorm = 70.4394, GNorm = 2.6702, lr_0 = 9.9851e-04
Validation auc = 0.606880
Epoch 71
Validation auc = 0.596467
Epoch 72
Validation auc = 0.580167
Epoch 73
Validation auc = 0.593741
Epoch 74
Validation auc = 0.609115
Epoch 75
Loss = 5.2174e-01, PNorm = 70.6842, GNorm = 1.2383, lr_0 = 9.9828e-04
Validation auc = 0.630486
Epoch 76
Validation auc = 0.642370
Epoch 77
Validation auc = 0.644606
Epoch 78
Validation auc = 0.647113
Epoch 79
Validation auc = 0.621490
Epoch 80
Loss = 6.3679e-01, PNorm = 70.9960, GNorm = 1.9485, lr_0 = 9.9802e-04
Validation auc = 0.594341
Epoch 81
Validation auc = 0.615385
Epoch 82
Validation auc = 0.624162
Epoch 83
Validation auc = 0.618765
Epoch 84
Loss = 5.7551e-01, PNorm = 71.3324, GNorm = 1.2116, lr_0 = 9.9779e-04
Loss = 4.9847e-01, PNorm = 71.3554, GNorm = 2.7207, lr_0 = 9.9777e-04
Validation auc = 0.598812
Epoch 85
Validation auc = 0.598157
Epoch 86
Validation auc = 0.575696
Epoch 87
Validation auc = 0.592706
Epoch 88
Validation auc = 0.629941
Epoch 89
Loss = 5.4370e-01, PNorm = 71.6940, GNorm = 1.2272, lr_0 = 9.9752e-04
Loss = 6.9008e-01, PNorm = 71.7135, GNorm = 2.3587, lr_0 = 9.9750e-04
Validation auc = 0.622908
Epoch 90
Validation auc = 0.597721
Epoch 91
Validation auc = 0.595322
Epoch 92
Validation auc = 0.591888
Epoch 93
Validation auc = 0.591888
Epoch 94
Loss = 4.0716e-01, PNorm = 72.0516, GNorm = 1.1795, lr_0 = 9.9727e-04
Validation auc = 0.622690
Epoch 95
Validation auc = 0.635774
Epoch 96
Validation auc = 0.608897
Epoch 97
Validation auc = 0.603664
Epoch 98
Validation auc = 0.657908
Epoch 99
Loss = 4.7768e-01, PNorm = 72.5594, GNorm = 1.5489, lr_0 = 9.9701e-04
Validation auc = 0.643297
Epoch 100
Validation auc = 0.608788
Epoch 101
Validation auc = 0.594614
Epoch 102
Validation auc = 0.604318
Epoch 103
Loss = 5.7073e-01, PNorm = 73.0385, GNorm = 1.6878, lr_0 = 9.9678e-04
Loss = 8.8862e-01, PNorm = 73.0641, GNorm = 5.2303, lr_0 = 9.9676e-04
Validation auc = 0.619310
Epoch 104
Validation auc = 0.632285
Epoch 105
Validation auc = 0.637246
Epoch 106
Validation auc = 0.616366
Epoch 107
Validation auc = 0.607643
Epoch 108
Loss = 3.6931e-01, PNorm = 73.4740, GNorm = 1.0631, lr_0 = 9.9651e-04
Validation auc = 0.585073
Epoch 109
Validation auc = 0.570081
Epoch 110
Validation auc = 0.610369
Epoch 111
Validation auc = 0.630758
Epoch 112
Validation auc = 0.605844
Epoch 113
Loss = 3.0332e-01, PNorm = 73.8964, GNorm = 0.9060, lr_0 = 9.9627e-04
Validation auc = 0.592488
Epoch 114
Validation auc = 0.591779
Epoch 115
Validation auc = 0.620019
Epoch 116
Validation auc = 0.598648
Epoch 117
Loss = 2.3249e-01, PNorm = 74.2713, GNorm = 0.9084, lr_0 = 9.9604e-04
Loss = 4.4744e-01, PNorm = 74.2976, GNorm = 2.9544, lr_0 = 9.9602e-04
Validation auc = 0.599684
Epoch 118
Validation auc = 0.619855
Epoch 119
Validation auc = 0.622635
Epoch 120
Validation auc = 0.609333
Epoch 121
Validation auc = 0.614403
Epoch 122
Loss = 3.9118e-01, PNorm = 74.7147, GNorm = 2.2981, lr_0 = 9.9577e-04
Loss = 1.5510e-01, PNorm = 74.7441, GNorm = 1.0503, lr_0 = 9.9575e-04
Validation auc = 0.599030
Epoch 123
Validation auc = 0.577550
Epoch 124
Validation auc = 0.586927
Epoch 125
Validation auc = 0.593960
Epoch 126
Validation auc = 0.606607
Epoch 127
Loss = 2.0118e-01, PNorm = 75.1034, GNorm = 0.9695, lr_0 = 9.9552e-04
Validation auc = 0.637191
Epoch 128
Validation auc = 0.636319
Epoch 129
Validation auc = 0.620727
Epoch 130
Validation auc = 0.598539
Epoch 131
Validation auc = 0.607698
Epoch 132
Loss = 5.8023e-01, PNorm = 75.5053, GNorm = 5.4969, lr_0 = 9.9526e-04
Validation auc = 0.631085
Epoch 133
Validation auc = 0.593741
Epoch 134
Validation auc = 0.595977
Epoch 135
Validation auc = 0.597012
Epoch 136
Loss = 2.2790e-01, PNorm = 75.9541, GNorm = 0.6072, lr_0 = 9.9503e-04
Loss = 7.1926e-02, PNorm = 75.9834, GNorm = 0.9689, lr_0 = 9.9501e-04
Validation auc = 0.608679
Epoch 137
Validation auc = 0.599847
Epoch 138
Validation auc = 0.574443
Epoch 139
Validation auc = 0.551764
Epoch 140
Validation auc = 0.567846
Epoch 141
Loss = 2.9677e-01, PNorm = 76.3950, GNorm = 2.1485, lr_0 = 9.9477e-04
Validation auc = 0.636046
Epoch 142
Validation auc = 0.628959
Epoch 143
Validation auc = 0.605026
Epoch 144
Validation auc = 0.593087
Epoch 145
Validation auc = 0.586327
Epoch 146
Loss = 1.2717e-01, PNorm = 76.8152, GNorm = 0.5468, lr_0 = 9.9452e-04
Validation auc = 0.578422
Epoch 147
Validation auc = 0.544077
Epoch 148
Validation auc = 0.510985
Epoch 149
Validation auc = 0.561849
Epoch 150
Loss = 2.8454e-01, PNorm = 77.4080, GNorm = 2.5113, lr_0 = 9.9429e-04
Loss = 1.6398e-01, PNorm = 77.4508, GNorm = 2.0568, lr_0 = 9.9427e-04
Validation auc = 0.588017
Epoch 151
Validation auc = 0.596631
Epoch 152
Validation auc = 0.601101
Epoch 153
Validation auc = 0.615875
Epoch 154
Validation auc = 0.626724
Epoch 155
Loss = 1.9918e-01, PNorm = 77.9672, GNorm = 1.1877, lr_0 = 9.9403e-04
Loss = 1.9058e-02, PNorm = 77.9982, GNorm = 0.2534, lr_0 = 9.9401e-04
Validation auc = 0.619419
Epoch 156
Validation auc = 0.604536
Epoch 157
Validation auc = 0.587799
Epoch 158
Validation auc = 0.587363
Epoch 159
Validation auc = 0.606335
Epoch 160
Loss = 1.0480e-01, PNorm = 78.4194, GNorm = 1.3062, lr_0 = 9.9378e-04
Validation auc = 0.614294
Epoch 161
Validation auc = 0.602137
Epoch 162
Validation auc = 0.590470
Epoch 163
Validation auc = 0.621927
Epoch 164
Validation auc = 0.649730
Epoch 165
Loss = 1.5835e-01, PNorm = 78.9186, GNorm = 1.3441, lr_0 = 9.9351e-04
Validation auc = 0.655836
Epoch 166
Validation auc = 0.665322
Epoch 167
Validation auc = 0.658889
Epoch 168
Validation auc = 0.624107
Epoch 169
Loss = 2.0346e-01, PNorm = 79.3950, GNorm = 1.9861, lr_0 = 9.9329e-04
Loss = 1.0939e-01, PNorm = 79.4290, GNorm = 1.1813, lr_0 = 9.9327e-04
Validation auc = 0.593632
Epoch 170
Validation auc = 0.589326
Epoch 171
Validation auc = 0.568718
Epoch 172
Validation auc = 0.561849
Epoch 173
Validation auc = 0.564302
Epoch 174
Loss = 1.0840e-01, PNorm = 79.8193, GNorm = 0.6466, lr_0 = 9.9302e-04
Validation auc = 0.563594
Epoch 175
Validation auc = 0.568391
Epoch 176
Validation auc = 0.569591
Epoch 177
Validation auc = 0.573679
Epoch 178
Validation auc = 0.569918
Epoch 179
Loss = 6.7722e-02, PNorm = 80.0820, GNorm = 0.8448, lr_0 = 9.9277e-04
Validation auc = 0.575696
Epoch 180
Validation auc = 0.578804
Epoch 181
Validation auc = 0.584256
Epoch 182
Validation auc = 0.585073
Epoch 183
Loss = 2.5410e-02, PNorm = 80.2975, GNorm = 0.1482, lr_0 = 9.9253e-04
Validation auc = 0.583111
Epoch 184
Validation auc = 0.590580
Epoch 185
Validation auc = 0.599793
Epoch 186
Validation auc = 0.615875
Epoch 187
Validation auc = 0.638772
Epoch 188
Loss = 1.0049e-01, PNorm = 80.5349, GNorm = 2.5646, lr_0 = 9.9228e-04
Loss = 4.6847e-01, PNorm = 80.5611, GNorm = 6.6964, lr_0 = 9.9226e-04
Validation auc = 0.658998
Epoch 189
Validation auc = 0.652020
Epoch 190
Validation auc = 0.638227
Epoch 191
Validation auc = 0.627433
Epoch 192
Validation auc = 0.623889
Epoch 193
Loss = 1.9538e-01, PNorm = 80.9932, GNorm = 1.0707, lr_0 = 9.9204e-04
Validation auc = 0.624652
Epoch 194
Validation auc = 0.620509
Epoch 195
Validation auc = 0.622908
Epoch 196
Validation auc = 0.622635
Epoch 197
Validation auc = 0.610805
Epoch 198
Loss = 1.4486e-01, PNorm = 81.4815, GNorm = 0.6410, lr_0 = 9.9177e-04
Validation auc = 0.587309
Epoch 199
Validation auc = 0.539715
Epoch 200
Validation auc = 0.531592
Epoch 201
Validation auc = 0.547838
Epoch 202
Loss = 1.7871e-01, PNorm = 81.9217, GNorm = 1.6699, lr_0 = 9.9154e-04
Loss = 1.2330e-01, PNorm = 81.9529, GNorm = 1.6411, lr_0 = 9.9153e-04
Validation auc = 0.561740
Epoch 203
Validation auc = 0.562503
Epoch 204
Validation auc = 0.564848
Epoch 205
Validation auc = 0.567737
Epoch 206
Validation auc = 0.577496
Epoch 207
Loss = 1.0197e-01, PNorm = 82.2953, GNorm = 1.5826, lr_0 = 9.9128e-04
Loss = 3.4467e-02, PNorm = 82.3158, GNorm = 0.9111, lr_0 = 9.9126e-04
Validation auc = 0.593632
Epoch 208
Validation auc = 0.593251
Epoch 209
Validation auc = 0.579949
Epoch 210
Validation auc = 0.568064
Epoch 211
Validation auc = 0.594995
Epoch 212
Loss = 2.2372e-01, PNorm = 82.5930, GNorm = 2.0852, lr_0 = 9.9103e-04
Validation auc = 0.602137
Epoch 213
Validation auc = 0.595050
Epoch 214
Validation auc = 0.574770
Epoch 215
Validation auc = 0.556725
Epoch 216
Loss = 1.5284e-01, PNorm = 82.9001, GNorm = 1.2481, lr_0 = 9.9079e-04
Validation auc = 0.542387
Epoch 217
Validation auc = 0.549528
Epoch 218
Validation auc = 0.572480
Epoch 219
Validation auc = 0.582566
Epoch 220
Validation auc = 0.576460
Epoch 221
Loss = 1.1274e-01, PNorm = 83.1943, GNorm = 1.6791, lr_0 = 9.9054e-04
Loss = 9.3625e-02, PNorm = 83.2135, GNorm = 2.1989, lr_0 = 9.9052e-04
Validation auc = 0.568664
Epoch 222
Validation auc = 0.575151
Epoch 223
Validation auc = 0.584801
Epoch 224
Validation auc = 0.586109
Epoch 225
Validation auc = 0.582784
Epoch 226
Loss = 5.9827e-02, PNorm = 83.4060, GNorm = 0.9467, lr_0 = 9.9030e-04
Validation auc = 0.589598
Epoch 227
Validation auc = 0.587145
Epoch 228
Validation auc = 0.559832
Epoch 229
Validation auc = 0.560541
Epoch 230
Validation auc = 0.563812
Epoch 231
Loss = 2.6061e-02, PNorm = 83.5887, GNorm = 0.3314, lr_0 = 9.9003e-04
Validation auc = 0.561849
Epoch 232
Validation auc = 0.563212
Epoch 233
Validation auc = 0.566865
Epoch 234
Validation auc = 0.570081
Epoch 235
Loss = 5.5582e-02, PNorm = 83.6950, GNorm = 1.3246, lr_0 = 9.8980e-04
Loss = 2.9742e-02, PNorm = 83.7034, GNorm = 0.7433, lr_0 = 9.8979e-04
Validation auc = 0.567792
Epoch 236
Validation auc = 0.562721
Epoch 237
Validation auc = 0.557979
Epoch 238
Validation auc = 0.557597
Epoch 239
Validation auc = 0.573897
Epoch 240
Loss = 1.1533e-02, PNorm = 83.8269, GNorm = 0.2382, lr_0 = 9.8954e-04
Loss = 3.5010e-03, PNorm = 83.8426, GNorm = 0.0695, lr_0 = 9.8952e-04
Validation auc = 0.584583
Epoch 241
Validation auc = 0.585564
Epoch 242
Validation auc = 0.588562
Epoch 243
Validation auc = 0.598212
Epoch 244
Validation auc = 0.607316
Epoch 245
Loss = 2.1093e-02, PNorm = 84.0053, GNorm = 0.3659, lr_0 = 9.8930e-04
Validation auc = 0.610587
Epoch 246
Validation auc = 0.605844
Epoch 247
Validation auc = 0.594941
Epoch 248
Validation auc = 0.594287
Epoch 249
Loss = 1.0109e-01, PNorm = 84.2150, GNorm = 0.2041, lr_0 = 9.8905e-04
Validation auc = 0.599411
Epoch 250
Validation auc = 0.592924
Epoch 251
Validation auc = 0.591506
Epoch 252
Validation auc = 0.591997
Epoch 253
Validation auc = 0.591016
Epoch 254
Loss = 7.5179e-02, PNorm = 84.5128, GNorm = 0.5123, lr_0 = 9.8880e-04
Loss = 6.3841e-02, PNorm = 84.5311, GNorm = 1.3155, lr_0 = 9.8879e-04
Validation auc = 0.587036
Epoch 255
Validation auc = 0.584038
Epoch 256
Validation auc = 0.583002
Epoch 257
Validation auc = 0.585946
Epoch 258
Validation auc = 0.604917
Epoch 259
Loss = 5.1329e-02, PNorm = 84.7667, GNorm = 0.5277, lr_0 = 9.8856e-04
Validation auc = 0.613477
Epoch 260
Validation auc = 0.615385
Epoch 261
Validation auc = 0.610478
Epoch 262
Validation auc = 0.607044
Epoch 263
Validation auc = 0.609987
Epoch 264
Loss = 7.8750e-03, PNorm = 84.9783, GNorm = 0.1317, lr_0 = 9.8830e-04
Validation auc = 0.610696
Epoch 265
Validation auc = 0.609824
Epoch 266
Validation auc = 0.609878
Epoch 267
Validation auc = 0.615439
Epoch 268
Loss = 7.7850e-02, PNorm = 85.0923, GNorm = 1.2354, lr_0 = 9.8807e-04
Loss = 3.6262e-02, PNorm = 85.1012, GNorm = 1.2208, lr_0 = 9.8805e-04
Validation auc = 0.623835
Epoch 269
Validation auc = 0.617020
Epoch 270
Validation auc = 0.612604
Epoch 271
Validation auc = 0.611187
Epoch 272
Validation auc = 0.618001
Epoch 273
Loss = 5.2528e-02, PNorm = 85.2306, GNorm = 1.2272, lr_0 = 9.8781e-04
Loss = 1.2485e-02, PNorm = 85.2389, GNorm = 0.3867, lr_0 = 9.8779e-04
Validation auc = 0.609170
Epoch 274
Validation auc = 0.599139
Epoch 275
Validation auc = 0.594450
Epoch 276
Validation auc = 0.592706
Epoch 277
Validation auc = 0.589980
Epoch 278
Loss = 1.8644e-02, PNorm = 85.3296, GNorm = 0.3116, lr_0 = 9.8756e-04
Validation auc = 0.585346
Epoch 279
Validation auc = 0.581857
Epoch 280
Validation auc = 0.578640
Epoch 281
Validation auc = 0.575696
Epoch 282
Validation auc = 0.573788
Epoch 283
Loss = 7.3604e-02, PNorm = 85.4292, GNorm = 0.7363, lr_0 = 9.8730e-04
Validation auc = 0.566592
Epoch 284
Validation auc = 0.572262
Epoch 285
Validation auc = 0.596304
Epoch 286
Validation auc = 0.611514
Epoch 287
Loss = 5.6466e-02, PNorm = 85.4940, GNorm = 0.1298, lr_0 = 9.8707e-04
Loss = 1.6543e-02, PNorm = 85.4992, GNorm = 0.4756, lr_0 = 9.8705e-04
Validation auc = 0.615167
Epoch 288
Validation auc = 0.614349
Epoch 289
Validation auc = 0.611841
Epoch 290
Validation auc = 0.610696
Epoch 291
Validation auc = 0.609061
Epoch 292
Loss = 4.1419e-03, PNorm = 85.5650, GNorm = 0.0599, lr_0 = 9.8683e-04
Validation auc = 0.589925
Epoch 293
Validation auc = 0.628142
Epoch 294
Validation auc = 0.631958
Epoch 295
Validation auc = 0.628687
Epoch 296
Validation auc = 0.630976
Epoch 297
Loss = 1.5290e-02, PNorm = 85.6484, GNorm = 0.3872, lr_0 = 9.8656e-04
Validation auc = 0.636592
Epoch 298
Validation auc = 0.636592
Epoch 299
Validation auc = 0.636919
Epoch 300
Validation auc = 0.636864
Epoch 301
Loss = 4.5337e-02, PNorm = 85.7204, GNorm = 0.7493, lr_0 = 9.8634e-04
Loss = 3.3168e-03, PNorm = 85.7260, GNorm = 0.1146, lr_0 = 9.8632e-04
Validation auc = 0.640462
Epoch 302
Validation auc = 0.643951
Epoch 303
Validation auc = 0.645968
Epoch 304
Validation auc = 0.648585
Epoch 305
Validation auc = 0.650930
Epoch 306
Loss = 1.3583e-02, PNorm = 85.7910, GNorm = 0.5680, lr_0 = 9.8607e-04
Loss = 4.5137e-04, PNorm = 85.7947, GNorm = 0.0149, lr_0 = 9.8606e-04
Validation auc = 0.653328
Epoch 307
Validation auc = 0.655618
Epoch 308
Validation auc = 0.656000
Epoch 309
Validation auc = 0.655345
Epoch 310
Validation auc = 0.656872
Epoch 311
Loss = 4.1833e-03, PNorm = 85.8339, GNorm = 0.1269, lr_0 = 9.8583e-04
Validation auc = 0.662542
Epoch 312
Validation auc = 0.654528
Epoch 313
Validation auc = 0.645260
Epoch 314
Validation auc = 0.635883
Epoch 315
Validation auc = 0.630595
Epoch 316
Loss = 1.9701e-02, PNorm = 85.8819, GNorm = 0.3644, lr_0 = 9.8557e-04
Validation auc = 0.628796
Epoch 317
Validation auc = 0.630758
Epoch 318
Validation auc = 0.633593
Epoch 319
Validation auc = 0.641171
Epoch 320
Loss = 1.3036e-01, PNorm = 86.0152, GNorm = 1.1039, lr_0 = 9.8534e-04
Loss = 1.5125e-03, PNorm = 86.0318, GNorm = 0.0404, lr_0 = 9.8532e-04
Validation auc = 0.652020
Epoch 321
Validation auc = 0.658071
Epoch 322
Validation auc = 0.664559
Epoch 323
Validation auc = 0.665922
Epoch 324
Validation auc = 0.669847
Epoch 325
Loss = 6.7157e-02, PNorm = 86.2196, GNorm = 0.5166, lr_0 = 9.8509e-04
Validation auc = 0.670883
Epoch 326
Validation auc = 0.665595
Epoch 327
Validation auc = 0.650057
Epoch 328
Validation auc = 0.666903
Epoch 329
Validation auc = 0.678406
Epoch 330
Loss = 1.2362e-01, PNorm = 86.4406, GNorm = 1.1982, lr_0 = 9.8483e-04
Validation auc = 0.671482
Epoch 331
Validation auc = 0.669193
Epoch 332
Validation auc = 0.666576
Epoch 333
Validation auc = 0.661833
Epoch 334
Loss = 3.6668e-02, PNorm = 86.7377, GNorm = 0.2372, lr_0 = 9.8461e-04
Loss = 2.5069e-02, PNorm = 86.7594, GNorm = 0.4913, lr_0 = 9.8459e-04
Validation auc = 0.648149
Epoch 335
Validation auc = 0.643079
Epoch 336
Validation auc = 0.651693
Epoch 337
Validation auc = 0.652729
Epoch 338
Validation auc = 0.645478
Epoch 339
Loss = 2.1939e-02, PNorm = 87.0264, GNorm = 0.1882, lr_0 = 9.8434e-04
Loss = 1.5525e-02, PNorm = 87.0411, GNorm = 0.6236, lr_0 = 9.8433e-04
Validation auc = 0.643624
Epoch 340
Validation auc = 0.653219
Epoch 341
Validation auc = 0.661724
Epoch 342
Validation auc = 0.660415
Epoch 343
Validation auc = 0.651148
Epoch 344
Loss = 1.9234e-01, PNorm = 87.1898, GNorm = 3.3233, lr_0 = 9.8410e-04
Validation auc = 0.663904
Epoch 345
Validation auc = 0.672736
Epoch 346
Validation auc = 0.672627
Epoch 347
Validation auc = 0.665322
Epoch 348
Validation auc = 0.652347
Epoch 349
Loss = 1.1358e-02, PNorm = 87.3997, GNorm = 0.1924, lr_0 = 9.8384e-04
Validation auc = 0.651529
Epoch 350
Validation auc = 0.669356
Epoch 351
Validation auc = 0.682549
Epoch 352
Validation auc = 0.684294
Epoch 353
Loss = 2.0656e-02, PNorm = 87.6064, GNorm = 0.4245, lr_0 = 9.8361e-04
Loss = 4.0640e-02, PNorm = 87.6208, GNorm = 1.8075, lr_0 = 9.8359e-04
Validation auc = 0.681295
Epoch 354
Validation auc = 0.678297
Epoch 355
Validation auc = 0.670610
Epoch 356
Validation auc = 0.662869
Epoch 357
Validation auc = 0.654909
Epoch 358
Loss = 3.7644e-02, PNorm = 87.7734, GNorm = 0.1257, lr_0 = 9.8335e-04
Validation auc = 0.644115
Epoch 359
Validation auc = 0.636592
Epoch 360
Validation auc = 0.625307
Epoch 361
Validation auc = 0.606716
Epoch 362
Validation auc = 0.634902
Epoch 363
Loss = 2.2955e-02, PNorm = 87.8740, GNorm = 0.4161, lr_0 = 9.8311e-04
Validation auc = 0.655836
Epoch 364
Validation auc = 0.668484
Epoch 365
Validation auc = 0.678679
Epoch 366
Validation auc = 0.680205
Epoch 367
Loss = 9.8713e-03, PNorm = 87.9561, GNorm = 0.1783, lr_0 = 9.8288e-04
Loss = 2.0187e-03, PNorm = 87.9613, GNorm = 0.0481, lr_0 = 9.8286e-04
Validation auc = 0.679823
Epoch 368
Validation auc = 0.673063
Epoch 369
Validation auc = 0.659707
Epoch 370
Validation auc = 0.649458
Epoch 371
Validation auc = 0.643188
Epoch 372
Loss = 8.8066e-03, PNorm = 88.1307, GNorm = 0.1988, lr_0 = 9.8262e-04
Loss = 1.2463e-03, PNorm = 88.1415, GNorm = 0.0246, lr_0 = 9.8260e-04
Validation auc = 0.635447
Epoch 373
Validation auc = 0.631631
Epoch 374
Validation auc = 0.634902
Epoch 375
Validation auc = 0.639263
Epoch 376
Validation auc = 0.648476
Epoch 377
Loss = 6.4821e-03, PNorm = 88.2168, GNorm = 0.4669, lr_0 = 9.8237e-04
Validation auc = 0.652674
Epoch 378
Validation auc = 0.656490
Epoch 379
Validation auc = 0.657962
Epoch 380
Validation auc = 0.661778
Epoch 381
Validation auc = 0.663523
Epoch 382
Loss = 5.8638e-03, PNorm = 88.2863, GNorm = 0.1148, lr_0 = 9.8211e-04
Validation auc = 0.664559
Epoch 383
Validation auc = 0.665485
Epoch 384
Validation auc = 0.664341
Epoch 385
Validation auc = 0.663359
Epoch 386
Loss = 2.4362e-03, PNorm = 88.3390, GNorm = 0.0542, lr_0 = 9.8189e-04
Loss = 1.0349e-03, PNorm = 88.3417, GNorm = 0.0273, lr_0 = 9.8187e-04
Validation auc = 0.662542
Epoch 387
Validation auc = 0.660088
Epoch 388
Validation auc = 0.661070
Epoch 389
Validation auc = 0.661669
Epoch 390
Validation auc = 0.662760
Epoch 391
Loss = 5.8672e-02, PNorm = 88.3665, GNorm = 0.6339, lr_0 = 9.8163e-04
Validation auc = 0.663577
Epoch 392
Validation auc = 0.663468
Epoch 393
Validation auc = 0.663632
Epoch 394
Validation auc = 0.665649
Epoch 395
Validation auc = 0.667394
Epoch 396
Loss = 2.9255e-02, PNorm = 88.4040, GNorm = 0.9882, lr_0 = 9.8138e-04
Validation auc = 0.673554
Epoch 397
Validation auc = 0.675626
Epoch 398
Validation auc = 0.679605
Epoch 399
Validation auc = 0.680696
Epoch 400
Loss = 5.2951e-02, PNorm = 88.4518, GNorm = 0.2504, lr_0 = 9.8116e-04
Loss = 4.0528e-03, PNorm = 88.4546, GNorm = 0.1388, lr_0 = 9.8114e-04
Validation auc = 0.671755
Epoch 401
Validation auc = 0.664722
Epoch 402
Validation auc = 0.661070
Epoch 403
Validation auc = 0.658780
Epoch 404
Validation auc = 0.654364
Epoch 405
Loss = 4.1312e-03, PNorm = 88.4997, GNorm = 0.0831, lr_0 = 9.8089e-04
Loss = 1.8350e-03, PNorm = 88.5023, GNorm = 0.0657, lr_0 = 9.8088e-04
Validation auc = 0.649785
Epoch 406
Validation auc = 0.645914
Epoch 407
Validation auc = 0.643461
Epoch 408
Validation auc = 0.642970
Epoch 409
Validation auc = 0.642370
Epoch 410
Loss = 1.5211e-01, PNorm = 88.5259, GNorm = 0.9764, lr_0 = 9.8065e-04
Validation auc = 0.639754
Epoch 411
Validation auc = 0.639481
Epoch 412
Validation auc = 0.633212
Epoch 413
Validation auc = 0.629014
Epoch 414
Validation auc = 0.625307
Epoch 415
Loss = 2.9146e-03, PNorm = 88.5529, GNorm = 0.0742, lr_0 = 9.8039e-04
Validation auc = 0.624216
Epoch 416
Validation auc = 0.622472
Epoch 417
Validation auc = 0.621381
Epoch 418
Validation auc = 0.624761
Epoch 419
Loss = 6.5077e-03, PNorm = 88.5766, GNorm = 0.2433, lr_0 = 9.8016e-04
Loss = 1.2068e-03, PNorm = 88.5787, GNorm = 0.0391, lr_0 = 9.8015e-04
Validation auc = 0.632721
Epoch 420
Validation auc = 0.638282
Epoch 421
Validation auc = 0.641825
Epoch 422
Validation auc = 0.644497
Epoch 423
Validation auc = 0.649239
Epoch 424
Loss = 3.1956e-03, PNorm = 88.6190, GNorm = 0.1032, lr_0 = 9.7990e-04
Validation auc = 0.651584
Epoch 425
Validation auc = 0.651202
Epoch 426
Validation auc = 0.652729
Epoch 427
Validation auc = 0.652729
Epoch 428
Validation auc = 0.647331
Epoch 429
Loss = 1.8239e-03, PNorm = 88.6659, GNorm = 0.0532, lr_0 = 9.7966e-04
Validation auc = 0.642316
Epoch 430
Validation auc = 0.641226
Epoch 431
Validation auc = 0.642261
Epoch 432
Validation auc = 0.642207
Epoch 433
Loss = 1.3514e-03, PNorm = 88.7000, GNorm = 0.0593, lr_0 = 9.7942e-04
Validation auc = 0.643188
Epoch 434
Validation auc = 0.642752
Epoch 435
Validation auc = 0.643297
Epoch 436
Validation auc = 0.643243
Epoch 437
Validation auc = 0.644715
Epoch 438
Loss = 2.5488e-03, PNorm = 88.7278, GNorm = 0.0080, lr_0 = 9.7917e-04
Loss = 1.3339e-04, PNorm = 88.7294, GNorm = 0.0057, lr_0 = 9.7916e-04
Validation auc = 0.641226
Epoch 439
Validation auc = 0.639154
Epoch 440
Validation auc = 0.631522
Epoch 441
Validation auc = 0.631194
Epoch 442
Validation auc = 0.632721
Epoch 443
Loss = 6.2787e-03, PNorm = 88.7731, GNorm = 0.2221, lr_0 = 9.7893e-04
Validation auc = 0.632884
Epoch 444
Validation auc = 0.636210
Epoch 445
Validation auc = 0.634629
Epoch 446
Validation auc = 0.636210
Epoch 447
Validation auc = 0.637082
Epoch 448
Loss = 4.6598e-04, PNorm = 88.8308, GNorm = 0.0109, lr_0 = 9.7867e-04
Validation auc = 0.636864
Epoch 449
Validation auc = 0.635447
Epoch 450
Validation auc = 0.622744
Epoch 451
Validation auc = 0.612386
Epoch 452
Loss = 5.2289e-02, PNorm = 88.9433, GNorm = 0.9707, lr_0 = 9.7845e-04
Loss = 1.1899e-03, PNorm = 88.9606, GNorm = 0.0272, lr_0 = 9.7843e-04
Validation auc = 0.624107
Epoch 453
Validation auc = 0.640244
Epoch 454
Validation auc = 0.671809
Epoch 455
Validation auc = 0.643461
Epoch 456
Validation auc = 0.643243
Epoch 457
Loss = 9.4849e-03, PNorm = 89.2981, GNorm = 0.2357, lr_0 = 9.7819e-04
Loss = 2.4197e-03, PNorm = 89.3228, GNorm = 0.0490, lr_0 = 9.7817e-04
Validation auc = 0.647004
Epoch 458
Validation auc = 0.649785
Epoch 459
Validation auc = 0.653110
Epoch 460
Validation auc = 0.660415
Epoch 461
Validation auc = 0.665540
Epoch 462
Loss = 2.7459e-03, PNorm = 89.5191, GNorm = 0.0664, lr_0 = 9.7794e-04
Validation auc = 0.668756
Epoch 463
Validation auc = 0.671101
Epoch 464
Validation auc = 0.672627
Epoch 465
Validation auc = 0.674535
Epoch 466
Loss = 7.4710e-02, PNorm = 89.6174, GNorm = 0.0356, lr_0 = 9.7770e-04
Validation auc = 0.678460
Epoch 467
Validation auc = 0.681950
Epoch 468
Validation auc = 0.684294
Epoch 469
Validation auc = 0.690454
Epoch 470
Validation auc = 0.693289
Epoch 471
Loss = 6.7103e-02, PNorm = 89.6861, GNorm = 0.0973, lr_0 = 9.7746e-04
Loss = 3.2151e-03, PNorm = 89.6896, GNorm = 0.2165, lr_0 = 9.7744e-04
Validation auc = 0.689800
Epoch 472
Validation auc = 0.687129
Epoch 473
Validation auc = 0.686420
Epoch 474
Validation auc = 0.686093
Epoch 475
Validation auc = 0.685111
Epoch 476
Loss = 2.7991e-03, PNorm = 89.7412, GNorm = 0.0856, lr_0 = 9.7721e-04
Validation auc = 0.681350
Epoch 477
Validation auc = 0.677643
Epoch 478
Validation auc = 0.674045
Epoch 479
Validation auc = 0.672027
Epoch 480
Validation auc = 0.668102
Epoch 481
Loss = 6.2841e-04, PNorm = 89.8081, GNorm = 0.0081, lr_0 = 9.7695e-04
Validation auc = 0.665267
Epoch 482
Validation auc = 0.664177
Epoch 483
Validation auc = 0.662433
Epoch 484
Validation auc = 0.660633
Epoch 485
Loss = 3.9714e-03, PNorm = 89.8476, GNorm = 0.1080, lr_0 = 9.7673e-04
Loss = 6.1635e-03, PNorm = 89.8512, GNorm = 0.2596, lr_0 = 9.7671e-04
Validation auc = 0.660306
Epoch 486
Validation auc = 0.649021
Epoch 487
Validation auc = 0.652620
Epoch 488
Validation auc = 0.674263
Epoch 489
Validation auc = 0.685820
Epoch 490
Loss = 1.5884e-02, PNorm = 89.9798, GNorm = 0.7186, lr_0 = 9.7647e-04
Loss = 2.2287e-04, PNorm = 89.9922, GNorm = 0.0059, lr_0 = 9.7645e-04
Validation auc = 0.683203
Epoch 491
Validation auc = 0.688110
Epoch 492
Validation auc = 0.684457
Epoch 493
Validation auc = 0.676171
Epoch 494
Validation auc = 0.669411
Epoch 495
Loss = 1.4189e-02, PNorm = 90.1319, GNorm = 0.2877, lr_0 = 9.7623e-04
Validation auc = 0.665431
Epoch 496
Validation auc = 0.662378
Epoch 497
Validation auc = 0.661070
Epoch 498
Validation auc = 0.648749
Epoch 499
Loss = 3.3160e-03, PNorm = 90.2283, GNorm = 0.1139, lr_0 = 9.7599e-04
Validation auc = 0.639645
Epoch 500
Validation auc = 0.632067
Epoch 501
Validation auc = 0.641444
Epoch 502
Validation auc = 0.651911
Epoch 503
Validation auc = 0.659598
Epoch 504
Loss = 3.3045e-03, PNorm = 90.3081, GNorm = 0.1039, lr_0 = 9.7574e-04
Loss = 2.5732e-04, PNorm = 90.3132, GNorm = 0.0143, lr_0 = 9.7573e-04
Validation auc = 0.666739
Epoch 505
Validation auc = 0.669574
Epoch 506
Validation auc = 0.659979
Epoch 507
Validation auc = 0.662978
Epoch 508
Validation auc = 0.665922
Epoch 509
Loss = 1.6842e-01, PNorm = 90.3632, GNorm = 0.7607, lr_0 = 9.7550e-04
Validation auc = 0.665267
Epoch 510
Validation auc = 0.661070
Epoch 511
Validation auc = 0.654582
Epoch 512
Validation auc = 0.651584
Epoch 513
Validation auc = 0.634247
Epoch 514
Loss = 2.9505e-02, PNorm = 90.7366, GNorm = 0.5464, lr_0 = 9.7524e-04
Validation auc = 0.637355
Epoch 515
Validation auc = 0.642425
Epoch 516
Validation auc = 0.648640
Epoch 517
Validation auc = 0.643297
Epoch 518
Loss = 8.8640e-02, PNorm = 91.2226, GNorm = 1.2930, lr_0 = 9.7502e-04
Loss = 3.9267e-01, PNorm = 91.2605, GNorm = 5.8627, lr_0 = 9.7500e-04
Validation auc = 0.629777
Epoch 519
Validation auc = 0.700104
Epoch 520
Validation auc = 0.727198
Epoch 521
Validation auc = 0.724963
Epoch 522
Validation auc = 0.713079
Epoch 523
Loss = 4.1429e-02, PNorm = 91.8040, GNorm = 0.3802, lr_0 = 9.7476e-04
Loss = 9.3254e-03, PNorm = 91.8345, GNorm = 0.2131, lr_0 = 9.7474e-04
Validation auc = 0.710135
Epoch 524
Validation auc = 0.710026
Epoch 525
Validation auc = 0.707354
Epoch 526
Validation auc = 0.704901
Epoch 527
Validation auc = 0.703047
Epoch 528
Loss = 1.9876e-02, PNorm = 92.1044, GNorm = 0.4118, lr_0 = 9.7452e-04
Validation auc = 0.700431
Epoch 529
Validation auc = 0.699068
Epoch 530
Validation auc = 0.707845
Epoch 531
Validation auc = 0.702775
Epoch 532
Validation auc = 0.690454
Epoch 533
Loss = 5.8780e-03, PNorm = 92.2977, GNorm = 0.1084, lr_0 = 9.7426e-04
Validation auc = 0.680259
Epoch 534
Validation auc = 0.676171
Epoch 535
Validation auc = 0.681622
Epoch 536
Validation auc = 0.687674
Epoch 537
Loss = 8.3770e-03, PNorm = 92.4429, GNorm = 0.1727, lr_0 = 9.7403e-04
Loss = 2.7981e-02, PNorm = 92.4539, GNorm = 1.2718, lr_0 = 9.7401e-04
Validation auc = 0.691708
Epoch 538
Validation auc = 0.693507
Epoch 539
Validation auc = 0.689582
Epoch 540
Validation auc = 0.685493
Epoch 541
Validation auc = 0.679496
Epoch 542
Loss = 7.6714e-03, PNorm = 92.5777, GNorm = 0.1641, lr_0 = 9.7379e-04
Validation auc = 0.676171
Epoch 543
Validation auc = 0.673990
Epoch 544
Validation auc = 0.671591
Epoch 545
Validation auc = 0.670992
Epoch 546
Validation auc = 0.672464
Epoch 547
Loss = 3.2919e-03, PNorm = 92.6685, GNorm = 0.0453, lr_0 = 9.7353e-04
Validation auc = 0.669956
Epoch 548
Validation auc = 0.666576
Epoch 549
Validation auc = 0.663468
Epoch 550
Validation auc = 0.662051
Epoch 551
Loss = 2.6193e-03, PNorm = 92.7081, GNorm = 0.0485, lr_0 = 9.7331e-04
Loss = 5.2872e-04, PNorm = 92.7105, GNorm = 0.0218, lr_0 = 9.7329e-04
Validation auc = 0.662705
Epoch 552
Validation auc = 0.663850
Epoch 553
Validation auc = 0.665595
Epoch 554
Validation auc = 0.686365
Epoch 555
Validation auc = 0.691108
Epoch 556
Loss = 2.4513e-01, PNorm = 92.9707, GNorm = 2.2465, lr_0 = 9.7305e-04
Loss = 6.3368e-03, PNorm = 93.0168, GNorm = 0.1963, lr_0 = 9.7303e-04
Validation auc = 0.692744
Epoch 557
Validation auc = 0.684621
Epoch 558
Validation auc = 0.668866
Epoch 559
Validation auc = 0.646296
Epoch 560
Validation auc = 0.646405
Epoch 561
Loss = 2.3450e-01, PNorm = 93.5701, GNorm = 1.6718, lr_0 = 9.7281e-04
Validation auc = 0.665704
Epoch 562
Validation auc = 0.674208
Epoch 563
Validation auc = 0.691272
Epoch 564
Validation auc = 0.675953
Epoch 565
Validation auc = 0.645750
Epoch 566
Loss = 1.8219e-01, PNorm = 94.1206, GNorm = 3.1982, lr_0 = 9.7255e-04
Validation auc = 0.657635
Epoch 567
Validation auc = 0.657090
Epoch 568
Validation auc = 0.649621
Epoch 569
Validation auc = 0.631085
Epoch 570
Loss = 2.7126e-02, PNorm = 94.7685, GNorm = 0.3931, lr_0 = 9.7232e-04
Loss = 4.2333e-02, PNorm = 94.8071, GNorm = 0.7568, lr_0 = 9.7231e-04
Validation auc = 0.628360
Epoch 571
Validation auc = 0.623726
Epoch 572
Validation auc = 0.612277
Epoch 573
Validation auc = 0.604645
Epoch 574
Validation auc = 0.599956
Epoch 575
Loss = 4.3969e-02, PNorm = 95.2069, GNorm = 0.4597, lr_0 = 9.7208e-04
Validation auc = 0.585182
Epoch 576
Validation auc = 0.569536
Epoch 577
Validation auc = 0.557161
Epoch 578
Validation auc = 0.551491
Epoch 579
Validation auc = 0.555852
Epoch 580
Loss = 1.4839e-02, PNorm = 95.4451, GNorm = 0.2937, lr_0 = 9.7182e-04
Validation auc = 0.571662
Epoch 581
Validation auc = 0.593469
Epoch 582
Validation auc = 0.605299
Epoch 583
Validation auc = 0.612659
Epoch 584
Loss = 1.7221e-02, PNorm = 95.5603, GNorm = 0.6594, lr_0 = 9.7160e-04
Loss = 6.0128e-03, PNorm = 95.5682, GNorm = 0.1378, lr_0 = 9.7158e-04
Validation auc = 0.615657
Epoch 585
Validation auc = 0.617402
Epoch 586
Validation auc = 0.616966
Epoch 587
Validation auc = 0.615494
Epoch 588
Validation auc = 0.607153
Epoch 589
Loss = 2.0284e-02, PNorm = 95.6427, GNorm = 0.8648, lr_0 = 9.7134e-04
Loss = 1.4610e-03, PNorm = 95.6469, GNorm = 0.0338, lr_0 = 9.7132e-04
Validation auc = 0.599466
Epoch 590
Validation auc = 0.596358
Epoch 591
Validation auc = 0.595977
Epoch 592
Validation auc = 0.595541
Epoch 593
Validation auc = 0.591016
Epoch 594
Loss = 3.4469e-03, PNorm = 95.7117, GNorm = 0.0902, lr_0 = 9.7110e-04
Validation auc = 0.574824
Epoch 595
Validation auc = 0.591670
Epoch 596
Validation auc = 0.595104
Epoch 597
Validation auc = 0.599302
Epoch 598
Validation auc = 0.602682
Epoch 599
Loss = 9.7085e-03, PNorm = 96.0879, GNorm = 0.1739, lr_0 = 9.7084e-04
Validation auc = 0.616039
Epoch 600
Validation auc = 0.640844
Epoch 601
Validation auc = 0.660906
Epoch 602
Validation auc = 0.651747
Epoch 603
Loss = 8.1480e-02, PNorm = 96.5027, GNorm = 0.5962, lr_0 = 9.7062e-04
Loss = 7.2313e-03, PNorm = 96.5293, GNorm = 0.1926, lr_0 = 9.7060e-04
Validation auc = 0.644388
Epoch 604
Validation auc = 0.653710
Epoch 605
Validation auc = 0.651093
Epoch 606
Validation auc = 0.643951
Epoch 607
Validation auc = 0.626124
Epoch 608
Loss = 1.1312e-01, PNorm = 96.8550, GNorm = 1.1385, lr_0 = 9.7036e-04
Validation auc = 0.563648
Epoch 609
Validation auc = 0.608134
Epoch 610
Validation auc = 0.588508
Epoch 611
Validation auc = 0.613477
Epoch 612
Validation auc = 0.596849
Epoch 613
Loss = 2.2189e-01, PNorm = 97.5206, GNorm = 1.6137, lr_0 = 9.7012e-04
Validation auc = 0.563594
Epoch 614
Validation auc = 0.575587
Epoch 615
Validation auc = 0.570408
Epoch 616
Validation auc = 0.594341
Epoch 617
Loss = 1.1625e-01, PNorm = 98.0859, GNorm = 0.5738, lr_0 = 9.6990e-04
Loss = 3.7578e-01, PNorm = 98.1207, GNorm = 5.0466, lr_0 = 9.6988e-04
Validation auc = 0.601210
Epoch 618
Validation auc = 0.601483
Epoch 619
Validation auc = 0.608134
Epoch 620
Validation auc = 0.615766
Epoch 621
Validation auc = 0.630867
Epoch 622
Loss = 5.6388e-02, PNorm = 98.5582, GNorm = 0.5429, lr_0 = 9.6964e-04
Loss = 2.8262e-02, PNorm = 98.5826, GNorm = 0.4082, lr_0 = 9.6962e-04
Validation auc = 0.633048
Epoch 623
Validation auc = 0.580548
Epoch 624
Validation auc = 0.571226
Epoch 625
Validation auc = 0.592433
Epoch 626
Validation auc = 0.612768
Epoch 627
Loss = 7.1807e-02, PNorm = 98.9766, GNorm = 0.3696, lr_0 = 9.6940e-04
Validation auc = 0.623889
Epoch 628
Validation auc = 0.623399
Epoch 629
Validation auc = 0.613804
Epoch 630
Validation auc = 0.605463
Epoch 631
Validation auc = 0.599139
Epoch 632
Loss = 1.4303e-02, PNorm = 99.4276, GNorm = 0.1336, lr_0 = 9.6914e-04
Validation auc = 0.598103
Epoch 633
Validation auc = 0.596740
Epoch 634
Validation auc = 0.594832
Epoch 635
Validation auc = 0.596195
Epoch 636
Loss = 2.2348e-02, PNorm = 99.6117, GNorm = 0.2182, lr_0 = 9.6892e-04
Loss = 5.9600e-02, PNorm = 99.6205, GNorm = 1.8893, lr_0 = 9.6890e-04
Validation auc = 0.589326
Epoch 637
Validation auc = 0.581584
Epoch 638
Validation auc = 0.571281
Epoch 639
Validation auc = 0.575478
Epoch 640
Validation auc = 0.590143
Epoch 641
Loss = 2.8752e-02, PNorm = 99.7358, GNorm = 0.1958, lr_0 = 9.6866e-04
Validation auc = 0.593033
Epoch 642
Validation auc = 0.593632
Epoch 643
Validation auc = 0.593523
Epoch 644
Validation auc = 0.597067
Epoch 645
Validation auc = 0.599575
Epoch 646
Loss = 2.4458e-02, PNorm = 99.8317, GNorm = 0.6677, lr_0 = 9.6842e-04
Validation auc = 0.602900
Epoch 647
Validation auc = 0.602410
Epoch 648
Validation auc = 0.602900
Epoch 649
Validation auc = 0.603173
Epoch 650
Loss = 1.0627e-02, PNorm = 99.8893, GNorm = 0.1058, lr_0 = 9.6820e-04
Loss = 2.9286e-03, PNorm = 99.8933, GNorm = 0.0846, lr_0 = 9.6818e-04
Validation auc = 0.601919
Epoch 651
Validation auc = 0.603991
Epoch 652
Validation auc = 0.605081
Epoch 653
Validation auc = 0.605844
Epoch 654
Validation auc = 0.605081
Epoch 655
Loss = 3.5809e-02, PNorm = 99.9541, GNorm = 0.7849, lr_0 = 9.6794e-04
Loss = 4.8055e-04, PNorm = 99.9595, GNorm = 0.0195, lr_0 = 9.6792e-04
Validation auc = 0.602682
Epoch 656
Validation auc = 0.595541
Epoch 657
Validation auc = 0.594287
Epoch 658
Validation auc = 0.592379
Epoch 659
Validation auc = 0.591452
Epoch 660
Loss = 2.0737e-03, PNorm = 100.0381, GNorm = 0.0503, lr_0 = 9.6770e-04
Validation auc = 0.594832
Epoch 661
Validation auc = 0.602682
Epoch 662
Validation auc = 0.608843
Epoch 663
Validation auc = 0.612986
Epoch 664
Validation auc = 0.617456
Epoch 665
Loss = 4.2379e-03, PNorm = 100.1720, GNorm = 0.0771, lr_0 = 9.6744e-04
Validation auc = 0.618110
Epoch 666
Validation auc = 0.616366
Epoch 667
Validation auc = 0.615657
Epoch 668
Validation auc = 0.612441
Epoch 669
Loss = 7.1827e-03, PNorm = 100.2679, GNorm = 0.2274, lr_0 = 9.6722e-04
Loss = 1.6438e-02, PNorm = 100.2736, GNorm = 0.2941, lr_0 = 9.6720e-04
Validation auc = 0.610369
Epoch 670
Validation auc = 0.608352
Epoch 671
Validation auc = 0.604100
Epoch 672
Validation auc = 0.597394
Epoch 673
Validation auc = 0.609824
Epoch 674
Loss = 5.2387e-02, PNorm = 100.4542, GNorm = 0.9967, lr_0 = 9.6696e-04
Validation auc = 0.616802
Epoch 675
Validation auc = 0.620073
Epoch 676
Validation auc = 0.622090
Epoch 677
Validation auc = 0.626015
Epoch 678
Validation auc = 0.628142
Epoch 679
Loss = 1.5361e-02, PNorm = 100.6899, GNorm = 0.3289, lr_0 = 9.6672e-04
Validation auc = 0.629286
Epoch 680
Validation auc = 0.630486
Epoch 681
Validation auc = 0.632612
Epoch 682
Validation auc = 0.631958
Epoch 683
Loss = 2.1092e-02, PNorm = 100.8248, GNorm = 0.3822, lr_0 = 9.6648e-04
Validation auc = 0.632285
Epoch 684
Validation auc = 0.629777
Epoch 685
Validation auc = 0.629068
Epoch 686
Validation auc = 0.629886
Epoch 687
Validation auc = 0.630322
Epoch 688
Loss = 5.1628e-03, PNorm = 100.9027, GNorm = 0.2288, lr_0 = 9.6624e-04
Loss = 1.5507e-02, PNorm = 100.9068, GNorm = 0.7029, lr_0 = 9.6622e-04
Validation auc = 0.629613
Epoch 689
Validation auc = 0.627651
Epoch 690
Validation auc = 0.626288
Epoch 691
Validation auc = 0.626015
Epoch 692
Validation auc = 0.626342
Epoch 693
Loss = 3.1189e-03, PNorm = 100.9611, GNorm = 0.0771, lr_0 = 9.6600e-04
Validation auc = 0.626561
Epoch 694
Validation auc = 0.626779
Epoch 695
Validation auc = 0.628305
Epoch 696
Validation auc = 0.628796
Epoch 697
Validation auc = 0.628087
Epoch 698
Loss = 7.6539e-03, PNorm = 100.9968, GNorm = 0.1882, lr_0 = 9.6574e-04
Validation auc = 0.628196
Epoch 699
Validation auc = 0.627596
Epoch 700
Validation auc = 0.627215
Epoch 701
Validation auc = 0.626615
Epoch 702
Loss = 1.3833e-03, PNorm = 101.0168, GNorm = 0.0411, lr_0 = 9.6552e-04
Loss = 1.3172e-03, PNorm = 101.0184, GNorm = 0.0463, lr_0 = 9.6550e-04
Validation auc = 0.626615
Epoch 703
Validation auc = 0.624543
Epoch 704
Validation auc = 0.621272
Epoch 705
Validation auc = 0.620019
Epoch 706
Validation auc = 0.618056
Epoch 707
Loss = 4.8527e-03, PNorm = 101.0310, GNorm = 0.0817, lr_0 = 9.6526e-04
Loss = 1.3322e-03, PNorm = 101.0322, GNorm = 0.0424, lr_0 = 9.6525e-04
Validation auc = 0.617565
Epoch 708
Validation auc = 0.617947
Epoch 709
Validation auc = 0.618656
Epoch 710
Validation auc = 0.619310
Epoch 711
Validation auc = 0.617456
Epoch 712
Loss = 2.6746e-02, PNorm = 101.0526, GNorm = 0.4906, lr_0 = 9.6502e-04
Validation auc = 0.615875
Epoch 713
Validation auc = 0.620727
Epoch 714
Validation auc = 0.623290
Epoch 715
Validation auc = 0.625579
Epoch 716
Loss = 7.7356e-03, PNorm = 101.0973, GNorm = 0.6864, lr_0 = 9.6479e-04
Validation auc = 0.627760
Epoch 717
Validation auc = 0.629395
Epoch 718
Validation auc = 0.630159
Epoch 719
Validation auc = 0.630704
Epoch 720
Validation auc = 0.631303
Epoch 721
Loss = 6.3264e-03, PNorm = 101.1248, GNorm = 0.0670, lr_0 = 9.6455e-04
Loss = 5.0679e-04, PNorm = 101.1269, GNorm = 0.0188, lr_0 = 9.6453e-04
Validation auc = 0.630976
Epoch 722
Validation auc = 0.632503
Epoch 723
Validation auc = 0.633266
Epoch 724
Validation auc = 0.632830
Epoch 725
Validation auc = 0.632666
Epoch 726
Loss = 3.8083e-03, PNorm = 101.1573, GNorm = 0.1236, lr_0 = 9.6431e-04
Validation auc = 0.632721
Epoch 727
Validation auc = 0.631522
Epoch 728
Validation auc = 0.633212
Epoch 729
Validation auc = 0.635828
Epoch 730
Validation auc = 0.637955
Epoch 731
Loss = 1.1725e-03, PNorm = 101.1718, GNorm = 0.0276, lr_0 = 9.6405e-04
Validation auc = 0.638936
Epoch 732
Validation auc = 0.638609
Epoch 733
Validation auc = 0.639536
Epoch 734
Validation auc = 0.640462
Epoch 735
Loss = 1.2555e-03, PNorm = 101.1948, GNorm = 0.0218, lr_0 = 9.6383e-04
Loss = 1.3192e-04, PNorm = 101.1963, GNorm = 0.0050, lr_0 = 9.6381e-04
Validation auc = 0.640135
Epoch 736
Validation auc = 0.639590
Epoch 737
Validation auc = 0.640190
Epoch 738
Validation auc = 0.640190
Epoch 739
Validation auc = 0.640081
Epoch 740
Loss = 1.7131e-03, PNorm = 101.2118, GNorm = 0.0919, lr_0 = 9.6357e-04
Loss = 7.2943e-05, PNorm = 101.2126, GNorm = 0.0031, lr_0 = 9.6355e-04
Validation auc = 0.639972
Epoch 741
Validation auc = 0.639263
Epoch 742
Validation auc = 0.639045
Epoch 743
Validation auc = 0.638827
Epoch 744
Validation auc = 0.637955
Epoch 745
Loss = 1.9790e-03, PNorm = 101.2199, GNorm = 0.0584, lr_0 = 9.6333e-04
Validation auc = 0.634902
Epoch 746
Validation auc = 0.627760
Epoch 747
Validation auc = 0.622417
Epoch 748
Validation auc = 0.618765
Epoch 749
Loss = 1.9797e-03, PNorm = 101.2246, GNorm = 0.0427, lr_0 = 9.6309e-04
Validation auc = 0.618329
Epoch 750
Validation auc = 0.619364
Epoch 751
Validation auc = 0.620073
Epoch 752
Validation auc = 0.620618
Epoch 753
Validation auc = 0.621218
Epoch 754
Loss = 1.2255e-03, PNorm = 101.2434, GNorm = 0.0243, lr_0 = 9.6285e-04
Loss = 3.2072e-04, PNorm = 101.2446, GNorm = 0.0090, lr_0 = 9.6284e-04
Validation auc = 0.622254
Epoch 755
Validation auc = 0.623835
Epoch 756
Validation auc = 0.625034
Epoch 757
Validation auc = 0.625525
Epoch 758
Validation auc = 0.626342
Epoch 759
Loss = 4.9281e-04, PNorm = 101.2574, GNorm = 0.0099, lr_0 = 9.6262e-04
Validation auc = 0.621600
Epoch 760
Validation auc = 0.619582
Epoch 761
Validation auc = 0.627487
Epoch 762
Validation auc = 0.635447
Epoch 763
Validation auc = 0.637955
Epoch 764
Loss = 9.0726e-04, PNorm = 101.3191, GNorm = 0.0246, lr_0 = 9.6236e-04
Validation auc = 0.638118
Epoch 765
Validation auc = 0.645532
Epoch 766
Validation auc = 0.657690
Epoch 767
Validation auc = 0.663523
Epoch 768
Loss = 3.3393e-02, PNorm = 101.3903, GNorm = 0.0080, lr_0 = 9.6214e-04
Loss = 8.6448e-04, PNorm = 101.3947, GNorm = 0.0246, lr_0 = 9.6212e-04
Validation auc = 0.668756
Epoch 769
Validation auc = 0.673445
Epoch 770
Validation auc = 0.681132
Epoch 771
Validation auc = 0.680423
Epoch 772
Validation auc = 0.667939
Epoch 773
Loss = 6.5935e-04, PNorm = 101.5003, GNorm = 0.0573, lr_0 = 9.6188e-04
Loss = 2.1304e-04, PNorm = 101.5101, GNorm = 0.0053, lr_0 = 9.6186e-04
Validation auc = 0.659652
Epoch 774
Validation auc = 0.653928
Epoch 775
Validation auc = 0.648585
Epoch 776
Validation auc = 0.642588
Epoch 777
Validation auc = 0.641553
Epoch 778
Loss = 6.9483e-04, PNorm = 101.5901, GNorm = 0.0181, lr_0 = 9.6164e-04
Validation auc = 0.640844
Epoch 779
Validation auc = 0.642588
Epoch 780
Validation auc = 0.642970
Epoch 781
Validation auc = 0.643570
Epoch 782
Validation auc = 0.644224
Epoch 783
Loss = 7.4594e-03, PNorm = 101.6285, GNorm = 0.1501, lr_0 = 9.6139e-04
Validation auc = 0.643679
Epoch 784
Validation auc = 0.644497
Epoch 785
Validation auc = 0.643733
Epoch 786
Validation auc = 0.644224
Epoch 787
Loss = 2.4274e-03, PNorm = 101.6665, GNorm = 0.0470, lr_0 = 9.6117e-04
Loss = 2.5772e-04, PNorm = 101.6688, GNorm = 0.0063, lr_0 = 9.6115e-04
Validation auc = 0.643406
Epoch 788
Validation auc = 0.645151
Epoch 789
Validation auc = 0.645042
Epoch 790
Validation auc = 0.643515
Epoch 791
Validation auc = 0.639972
Epoch 792
Loss = 3.1056e-04, PNorm = 101.6944, GNorm = 0.0068, lr_0 = 9.6093e-04
Validation auc = 0.637573
Epoch 793
Validation auc = 0.636592
Epoch 794
Validation auc = 0.635229
Epoch 795
Validation auc = 0.633484
Epoch 796
Validation auc = 0.633157
Epoch 797
Loss = 4.4305e-03, PNorm = 101.7170, GNorm = 0.1447, lr_0 = 9.6067e-04
Validation auc = 0.634847
Epoch 798
Validation auc = 0.636810
Epoch 799
Validation auc = 0.638772
Epoch 800
Validation auc = 0.639863
Epoch 801
Loss = 9.9391e-04, PNorm = 101.7313, GNorm = 0.0400, lr_0 = 9.6045e-04
Loss = 6.4077e-04, PNorm = 101.7326, GNorm = 0.0245, lr_0 = 9.6043e-04
Validation auc = 0.640353
Epoch 802
Validation auc = 0.640081
Epoch 803
Validation auc = 0.642316
Epoch 804
Validation auc = 0.646895
Epoch 805
Validation auc = 0.649458
Epoch 806
Loss = 2.6678e-03, PNorm = 101.7539, GNorm = 0.0739, lr_0 = 9.6019e-04
Loss = 4.9748e-04, PNorm = 101.7557, GNorm = 0.0242, lr_0 = 9.6018e-04
Validation auc = 0.651366
Epoch 807
Validation auc = 0.653710
Epoch 808
Validation auc = 0.655945
Epoch 809
Validation auc = 0.656708
Epoch 810
Validation auc = 0.657581
Epoch 811
Loss = 1.1564e-03, PNorm = 101.7925, GNorm = 0.0326, lr_0 = 9.5996e-04
Validation auc = 0.657362
Epoch 812
Validation auc = 0.656763
Epoch 813
Validation auc = 0.656926
Epoch 814
Validation auc = 0.657526
Epoch 815
Validation auc = 0.657308
Epoch 816
Loss = 6.8451e-04, PNorm = 101.8184, GNorm = 0.0346, lr_0 = 9.5970e-04
Validation auc = 0.657253
Epoch 817
Validation auc = 0.654964
Epoch 818
Validation auc = 0.652838
Epoch 819
Validation auc = 0.649567
Epoch 820
Loss = 1.5087e-01, PNorm = 101.8258, GNorm = 0.8351, lr_0 = 9.5948e-04
Loss = 1.0612e-04, PNorm = 101.8262, GNorm = 0.0038, lr_0 = 9.5946e-04
Validation auc = 0.642370
Epoch 821
Validation auc = 0.634084
Epoch 822
Validation auc = 0.646241
Epoch 823
Validation auc = 0.650602
Epoch 824
Validation auc = 0.649021
Epoch 825
Loss = 1.1981e-02, PNorm = 101.8588, GNorm = 0.5517, lr_0 = 9.5924e-04
Validation auc = 0.649621
Epoch 826
Validation auc = 0.650493
Epoch 827
Validation auc = 0.650275
Epoch 828
Validation auc = 0.649185
Epoch 829
Validation auc = 0.649676
Epoch 830
Loss = 5.6004e-04, PNorm = 101.8903, GNorm = 0.0092, lr_0 = 9.5899e-04
Validation auc = 0.649458
Epoch 831
Validation auc = 0.648749
Epoch 832
Validation auc = 0.649130
Epoch 833
Validation auc = 0.648803
Epoch 834
Loss = 7.5658e-04, PNorm = 101.9069, GNorm = 0.0077, lr_0 = 9.5877e-04
Loss = 1.2758e-04, PNorm = 101.9079, GNorm = 0.0066, lr_0 = 9.5875e-04
Validation auc = 0.648531
Epoch 835
Validation auc = 0.648803
Epoch 836
Validation auc = 0.649294
Epoch 837
Validation auc = 0.649621
Epoch 838
Validation auc = 0.651039
Epoch 839
Loss = 2.5319e-03, PNorm = 101.9221, GNorm = 0.1559, lr_0 = 9.5851e-04
Loss = 1.4071e-04, PNorm = 101.9236, GNorm = 0.0068, lr_0 = 9.5849e-04
Validation auc = 0.652020
Epoch 840
Validation auc = 0.653219
Epoch 841
Validation auc = 0.654855
Epoch 842
Validation auc = 0.661669
Epoch 843
Validation auc = 0.671210
Epoch 844
Loss = 8.5618e-02, PNorm = 101.9880, GNorm = 3.2550, lr_0 = 9.5827e-04
Validation auc = 0.663577
Epoch 845
Validation auc = 0.632285
Epoch 846
Validation auc = 0.644333
Epoch 847
Validation auc = 0.632830
Epoch 848
Validation auc = 0.628959
Epoch 849
Loss = 8.3476e-02, PNorm = 102.4605, GNorm = 1.1020, lr_0 = 9.5802e-04
Validation auc = 0.624434
Epoch 850
Validation auc = 0.622036
Epoch 851
Validation auc = 0.622635
Epoch 852
Validation auc = 0.625525
Epoch 853
Loss = 1.5778e-02, PNorm = 102.7249, GNorm = 0.1681, lr_0 = 9.5780e-04
Loss = 6.7390e-04, PNorm = 102.7393, GNorm = 0.0240, lr_0 = 9.5778e-04
Validation auc = 0.628469
Epoch 854
Validation auc = 0.627651
Epoch 855
Validation auc = 0.624816
Epoch 856
Validation auc = 0.624489
Epoch 857
Validation auc = 0.621818
Epoch 858
Loss = 3.0450e-03, PNorm = 102.8747, GNorm = 0.0423, lr_0 = 9.5754e-04
Validation auc = 0.618874
Epoch 859
Validation auc = 0.616529
Epoch 860
Validation auc = 0.601810
Epoch 861
Validation auc = 0.564739
Epoch 862
Validation auc = 0.634247
Epoch 863
Loss = 4.8264e-03, PNorm = 102.9550, GNorm = 0.1487, lr_0 = 9.5730e-04
Validation auc = 0.656436
Epoch 864
Validation auc = 0.670174
Epoch 865
Validation auc = 0.679333
Epoch 866
Validation auc = 0.683476
Epoch 867
Loss = 1.1276e-02, PNorm = 103.0609, GNorm = 0.1809, lr_0 = 9.5708e-04
Loss = 1.1021e-02, PNorm = 103.0688, GNorm = 0.3594, lr_0 = 9.5707e-04
Validation auc = 0.681840
Epoch 868
Validation auc = 0.680859
Epoch 869
Validation auc = 0.679605
Epoch 870
Validation auc = 0.680478
Epoch 871
Validation auc = 0.677207
Epoch 872
Loss = 4.0006e-03, PNorm = 103.1593, GNorm = 0.1408, lr_0 = 9.5683e-04
Loss = 5.3220e-03, PNorm = 103.1652, GNorm = 0.2150, lr_0 = 9.5681e-04
Validation auc = 0.676552
Epoch 873
Validation auc = 0.674862
Epoch 874
Validation auc = 0.673063
Epoch 875
Validation auc = 0.669084
Epoch 876
Validation auc = 0.665976
Epoch 877
Loss = 1.2564e-03, PNorm = 103.2282, GNorm = 0.0236, lr_0 = 9.5659e-04
Validation auc = 0.662923
Epoch 878
Validation auc = 0.662487
Epoch 879
Validation auc = 0.662487
Epoch 880
Validation auc = 0.664232
Epoch 881
Validation auc = 0.664341
Epoch 882
Loss = 1.1220e-03, PNorm = 103.3358, GNorm = 0.0213, lr_0 = 9.5634e-04
Validation auc = 0.666630
Epoch 883
Validation auc = 0.684784
Epoch 884
Validation auc = 0.690182
Epoch 885
Validation auc = 0.691163
Epoch 886
Loss = 3.3545e-03, PNorm = 103.4189, GNorm = 0.0893, lr_0 = 9.5612e-04
Loss = 1.6251e-03, PNorm = 103.4245, GNorm = 0.0528, lr_0 = 9.5610e-04
Validation auc = 0.690182
Epoch 887
Validation auc = 0.688328
Epoch 888
Validation auc = 0.688110
Epoch 889
Validation auc = 0.688164
Epoch 890
Validation auc = 0.686802
Epoch 891
Loss = 1.5960e-03, PNorm = 103.4861, GNorm = 0.0100, lr_0 = 9.5586e-04
Validation auc = 0.685111
Epoch 892
Validation auc = 0.690618
Epoch 893
Validation auc = 0.693453
Epoch 894
Validation auc = 0.677043
Epoch 895
Validation auc = 0.656327
Epoch 896
Loss = 1.6862e-02, PNorm = 103.5707, GNorm = 0.5456, lr_0 = 9.5563e-04
Validation auc = 0.626779
Epoch 897
Validation auc = 0.646786
Epoch 898
Validation auc = 0.658507
Epoch 899
Validation auc = 0.660143
Epoch 900
Loss = 1.1266e-01, PNorm = 104.0724, GNorm = 4.1333, lr_0 = 9.5541e-04
Loss = 1.0703e-03, PNorm = 104.1082, GNorm = 0.0414, lr_0 = 9.5539e-04
Validation auc = 0.646514
Epoch 901
Validation auc = 0.641662
Epoch 902
Validation auc = 0.639754
Epoch 903
Validation auc = 0.639590
Epoch 904
Validation auc = 0.638227
Epoch 905
Loss = 1.0808e-01, PNorm = 104.5550, GNorm = 0.9129, lr_0 = 9.5515e-04
Loss = 1.6891e-02, PNorm = 104.5855, GNorm = 0.8775, lr_0 = 9.5513e-04
Validation auc = 0.647440
Epoch 906
Validation auc = 0.638391
Epoch 907
Validation auc = 0.619201
Epoch 908
Validation auc = 0.614076
Epoch 909
Validation auc = 0.618710
Epoch 910
Loss = 7.1712e-02, PNorm = 104.9244, GNorm = 0.9141, lr_0 = 9.5491e-04
Validation auc = 0.622526
Epoch 911
Validation auc = 0.623562
Epoch 912
Validation auc = 0.625198
Epoch 913
Validation auc = 0.634520
Epoch 914
Validation auc = 0.636265
Epoch 915
Loss = 3.5439e-03, PNorm = 105.2024, GNorm = 0.0558, lr_0 = 9.5466e-04
Validation auc = 0.636046
Epoch 916
Validation auc = 0.635665
Epoch 917
Validation auc = 0.623617
Epoch 918
Validation auc = 0.618056
Epoch 919
Loss = 7.6862e-03, PNorm = 105.4621, GNorm = 0.2282, lr_0 = 9.5444e-04
Loss = 4.7308e-04, PNorm = 105.4791, GNorm = 0.0213, lr_0 = 9.5442e-04
Validation auc = 0.614240
Epoch 920
Validation auc = 0.609933
Epoch 921
Validation auc = 0.594668
Epoch 922
Validation auc = 0.584910
Epoch 923
Validation auc = 0.595486
Epoch 924
Loss = 7.6098e-03, PNorm = 105.6697, GNorm = 0.1702, lr_0 = 9.5419e-04
Validation auc = 0.603391
Epoch 925
Validation auc = 0.602955
Epoch 926
Validation auc = 0.601646
Epoch 927
Validation auc = 0.599793
Epoch 928
Validation auc = 0.597340
Epoch 929
Loss = 2.7811e-03, PNorm = 105.7742, GNorm = 0.0552, lr_0 = 9.5395e-04
Validation auc = 0.595431
Epoch 930
Validation auc = 0.593142
Epoch 931
Validation auc = 0.593796
Epoch 932
Validation auc = 0.594123
Epoch 933
Loss = 2.9919e-03, PNorm = 105.8141, GNorm = 0.0528, lr_0 = 9.5371e-04
Validation auc = 0.594668
Epoch 934
Validation auc = 0.594723
Epoch 935
Validation auc = 0.595268
Epoch 936
Validation auc = 0.596631
Epoch 937
Validation auc = 0.597558
Epoch 938
Loss = 5.8195e-02, PNorm = 105.8445, GNorm = 0.0196, lr_0 = 9.5348e-04
Loss = 5.4843e-03, PNorm = 105.8465, GNorm = 0.1285, lr_0 = 9.5346e-04
Validation auc = 0.599193
Epoch 939
Validation auc = 0.599629
Epoch 940
Validation auc = 0.599793
Epoch 941
Validation auc = 0.600120
Epoch 942
Validation auc = 0.599956
Epoch 943
Loss = 1.4306e-03, PNorm = 105.8787, GNorm = 0.0498, lr_0 = 9.5324e-04
Validation auc = 0.605190
Epoch 944
Validation auc = 0.604917
Epoch 945
Validation auc = 0.605299
Epoch 946
Validation auc = 0.605026
Epoch 947
Validation auc = 0.605572
Epoch 948
Loss = 2.3273e-03, PNorm = 105.9747, GNorm = 0.0480, lr_0 = 9.5299e-04
Validation auc = 0.607752
Epoch 949
Validation auc = 0.608952
Epoch 950
Validation auc = 0.609279
Epoch 951
Validation auc = 0.609006
Epoch 952
Loss = 2.5038e-03, PNorm = 106.0228, GNorm = 0.0370, lr_0 = 9.5277e-04
Loss = 3.1328e-04, PNorm = 106.0266, GNorm = 0.0077, lr_0 = 9.5275e-04
Validation auc = 0.608406
Epoch 953
Validation auc = 0.608134
Epoch 954
Validation auc = 0.607153
Epoch 955
Validation auc = 0.605735
Epoch 956
Validation auc = 0.603064
Epoch 957
Loss = 1.3754e-03, PNorm = 106.0647, GNorm = 0.0261, lr_0 = 9.5251e-04
Loss = 7.6705e-04, PNorm = 106.0666, GNorm = 0.0264, lr_0 = 9.5250e-04
Validation auc = 0.601592
Epoch 958
Validation auc = 0.599575
Epoch 959
Validation auc = 0.598212
Epoch 960
Validation auc = 0.597612
Epoch 961
Validation auc = 0.596794
Epoch 962
Loss = 1.2678e-03, PNorm = 106.0843, GNorm = 0.0497, lr_0 = 9.5228e-04
Validation auc = 0.595650
Epoch 963
Validation auc = 0.595813
Epoch 964
Validation auc = 0.595704
Epoch 965
Validation auc = 0.596195
Epoch 966
Loss = 4.2188e-04, PNorm = 106.0944, GNorm = 0.0190, lr_0 = 9.5204e-04
Validation auc = 0.597067
Epoch 967
Validation auc = 0.589217
Epoch 968
Validation auc = 0.579949
Epoch 969
Validation auc = 0.605299
Epoch 970
Validation auc = 0.627433
Epoch 971
Loss = 1.6496e-02, PNorm = 106.2248, GNorm = 0.6032, lr_0 = 9.5180e-04
Loss = 6.6281e-04, PNorm = 106.2389, GNorm = 0.0198, lr_0 = 9.5179e-04
Validation auc = 0.641607
Epoch 972
Validation auc = 0.653873
Epoch 973
Validation auc = 0.664613
Epoch 974
Validation auc = 0.663741
Epoch 975
Validation auc = 0.645641
Epoch 976
Loss = 3.5643e-02, PNorm = 106.4410, GNorm = 1.3283, lr_0 = 9.5157e-04
Validation auc = 0.647113
Epoch 977
Validation auc = 0.639754
Epoch 978
Validation auc = 0.643352
Epoch 979
Validation auc = 0.660143
Epoch 980
Validation auc = 0.677207
Epoch 981
Loss = 9.5567e-02, PNorm = 106.8656, GNorm = 1.8717, lr_0 = 9.5132e-04
Validation auc = 0.646350
Epoch 982
Validation auc = 0.623017
Epoch 983
Validation auc = 0.613531
Epoch 984
Validation auc = 0.613586
Epoch 985
Loss = 6.6350e-02, PNorm = 107.2026, GNorm = 0.7785, lr_0 = 9.5110e-04
Loss = 7.2827e-03, PNorm = 107.2319, GNorm = 0.2661, lr_0 = 9.5108e-04
Validation auc = 0.609715
Epoch 986
Validation auc = 0.611078
Epoch 987
Validation auc = 0.613749
Epoch 988
Validation auc = 0.616257
Epoch 989
Validation auc = 0.620782
Epoch 990
Loss = 3.2844e-03, PNorm = 107.5983, GNorm = 0.0709, lr_0 = 9.5084e-04
Loss = 1.7339e-04, PNorm = 107.6164, GNorm = 0.0077, lr_0 = 9.5083e-04
Validation auc = 0.624543
Epoch 991
Validation auc = 0.631958
Epoch 992
Validation auc = 0.638009
Epoch 993
Validation auc = 0.629068
Epoch 994
Validation auc = 0.612114
Epoch 995
Loss = 2.5701e-02, PNorm = 107.8675, GNorm = 0.5705, lr_0 = 9.5061e-04
Validation auc = 0.608570
Epoch 996
Validation auc = 0.614185
Epoch 997
Validation auc = 0.622962
Epoch 998
Validation auc = 0.631903
Epoch 999
Loss = 7.6960e-02, PNorm = 108.3097, GNorm = 0.0169, lr_0 = 9.5037e-04
Validation auc = 0.645750
Epoch 1000
Validation auc = 0.666303
Epoch 1001
Validation auc = 0.669738
Epoch 1002
Validation auc = 0.667012
Epoch 1003
Validation auc = 0.671210
Epoch 1004
Loss = 5.9538e-02, PNorm = 109.0924, GNorm = 1.1798, lr_0 = 9.5014e-04
Loss = 8.3155e-03, PNorm = 109.1318, GNorm = 0.1448, lr_0 = 9.5012e-04
Validation auc = 0.673936
Epoch 1005
Validation auc = 0.672682
Epoch 1006
Validation auc = 0.671482
Epoch 1007
Validation auc = 0.662214
Epoch 1008
Validation auc = 0.646078
Epoch 1009
Loss = 8.4141e-02, PNorm = 109.5180, GNorm = 1.4043, lr_0 = 9.4990e-04
Validation auc = 0.636319
Epoch 1010
Validation auc = 0.636428
Epoch 1011
Validation auc = 0.641007
Epoch 1012
Validation auc = 0.639154
Epoch 1013
Validation auc = 0.636973
Epoch 1014
Loss = 1.1834e-01, PNorm = 109.9903, GNorm = 2.3387, lr_0 = 9.4965e-04
Validation auc = 0.645587
Epoch 1015
Validation auc = 0.645641
Epoch 1016
Validation auc = 0.641825
Epoch 1017
Validation auc = 0.636374
Epoch 1018
Loss = 7.5214e-02, PNorm = 110.3929, GNorm = 1.0081, lr_0 = 9.4943e-04
Loss = 1.6458e-02, PNorm = 110.4135, GNorm = 0.4863, lr_0 = 9.4941e-04
Validation auc = 0.630050
Epoch 1019
Validation auc = 0.621109
Epoch 1020
Validation auc = 0.621109
Epoch 1021
Validation auc = 0.622581
Epoch 1022
Validation auc = 0.623344
Epoch 1023
Loss = 9.2321e-03, PNorm = 110.6328, GNorm = 0.1342, lr_0 = 9.4918e-04
Loss = 6.8658e-03, PNorm = 110.6436, GNorm = 0.1894, lr_0 = 9.4916e-04
Validation auc = 0.624652
Epoch 1024
Validation auc = 0.624216
Epoch 1025
Validation auc = 0.624761
Epoch 1026
Validation auc = 0.623453
Epoch 1027
Validation auc = 0.623671
Epoch 1028
Loss = 1.6759e-03, PNorm = 110.7299, GNorm = 0.0415, lr_0 = 9.4894e-04
Validation auc = 0.622199
Epoch 1029
Validation auc = 0.621490
Epoch 1030
Validation auc = 0.621327
Epoch 1031
Validation auc = 0.620891
Epoch 1032
Validation auc = 0.621327
Epoch 1033
Loss = 5.8388e-03, PNorm = 110.7781, GNorm = 0.1268, lr_0 = 9.4869e-04
Validation auc = 0.622690
Epoch 1034
Validation auc = 0.622417
Epoch 1035
Validation auc = 0.621818
Epoch 1036
Validation auc = 0.620891
Epoch 1037
Loss = 1.3777e-02, PNorm = 110.8124, GNorm = 0.0121, lr_0 = 9.4847e-04
Loss = 8.0711e-04, PNorm = 110.8153, GNorm = 0.0285, lr_0 = 9.4845e-04
Validation auc = 0.618819
Epoch 1038
Validation auc = 0.616638
Epoch 1039
Validation auc = 0.614349
Epoch 1040
Validation auc = 0.612822
Epoch 1041
Validation auc = 0.611677
Epoch 1042
Loss = 5.0212e-04, PNorm = 110.8446, GNorm = 0.0094, lr_0 = 9.4823e-04
Validation auc = 0.610042
Epoch 1043
Validation auc = 0.608843
Epoch 1044
Validation auc = 0.606716
Epoch 1045
Validation auc = 0.606389
Epoch 1046
Validation auc = 0.610369
Epoch 1047
Loss = 1.3981e-03, PNorm = 110.8641, GNorm = 0.0384, lr_0 = 9.4798e-04
Validation auc = 0.612386
Epoch 1048
Validation auc = 0.614567
Epoch 1049
Validation auc = 0.621000
Epoch 1050
Validation auc = 0.623780
Epoch 1051
Loss = 7.6145e-03, PNorm = 110.8933, GNorm = 0.2990, lr_0 = 9.4776e-04
Loss = 7.8106e-04, PNorm = 110.8968, GNorm = 0.0190, lr_0 = 9.4775e-04
Validation auc = 0.624543
Epoch 1052
Validation auc = 0.625906
Epoch 1053
Validation auc = 0.627051
Epoch 1054
Validation auc = 0.626997
Epoch 1055
Validation auc = 0.627596
Epoch 1056
Loss = 9.3870e-04, PNorm = 110.9345, GNorm = 0.0047, lr_0 = 9.4751e-04
Loss = 2.3097e-03, PNorm = 110.9362, GNorm = 0.1140, lr_0 = 9.4749e-04
Validation auc = 0.627324
Epoch 1057
Validation auc = 0.628305
Epoch 1058
Validation auc = 0.619691
Epoch 1059
Validation auc = 0.606335
Epoch 1060
Validation auc = 0.608352
Epoch 1061
Loss = 6.3768e-03, PNorm = 111.0435, GNorm = 0.1606, lr_0 = 9.4728e-04
Validation auc = 0.604808
Epoch 1062
Validation auc = 0.602028
Epoch 1063
Validation auc = 0.591724
Epoch 1064
Validation auc = 0.595050
Epoch 1065
Validation auc = 0.605681
Epoch 1066
Loss = 3.7533e-02, PNorm = 111.4062, GNorm = 0.9323, lr_0 = 9.4702e-04
Validation auc = 0.616529
Epoch 1067
Validation auc = 0.623017
Epoch 1068
Validation auc = 0.630159
Epoch 1069
Validation auc = 0.634738
Epoch 1070
Loss = 2.6255e-02, PNorm = 111.6373, GNorm = 0.7615, lr_0 = 9.4681e-04
Loss = 1.7000e-03, PNorm = 111.6486, GNorm = 0.0378, lr_0 = 9.4679e-04
Validation auc = 0.635283
Epoch 1071
Validation auc = 0.634574
Epoch 1072
Validation auc = 0.631740
Epoch 1073
Validation auc = 0.629123
Epoch 1074
Validation auc = 0.632448
Epoch 1075
Loss = 2.1744e-03, PNorm = 111.7622, GNorm = 0.0516, lr_0 = 9.4657e-04
Validation auc = 0.628959
Epoch 1076
Validation auc = 0.637246
Epoch 1077
Validation auc = 0.632721
Epoch 1078
Validation auc = 0.613204
Epoch 1079
Validation auc = 0.602519
Epoch 1080
Loss = 2.8355e-02, PNorm = 112.1558, GNorm = 0.3182, lr_0 = 9.4632e-04
Validation auc = 0.591724
Epoch 1081
Validation auc = 0.581639
Epoch 1082
Validation auc = 0.571880
Epoch 1083
Validation auc = 0.568609
Epoch 1084
Loss = 4.3490e-02, PNorm = 112.4935, GNorm = 1.4495, lr_0 = 9.4610e-04
Loss = 2.4611e-01, PNorm = 112.5093, GNorm = 4.3776, lr_0 = 9.4608e-04
Validation auc = 0.565665
Epoch 1085
Validation auc = 0.554598
Epoch 1086
Validation auc = 0.558088
Epoch 1087
Validation auc = 0.570844
Epoch 1088
Validation auc = 0.602464
Epoch 1089
Loss = 1.5523e-01, PNorm = 112.9130, GNorm = 1.5064, lr_0 = 9.4585e-04
Loss = 2.0699e-02, PNorm = 112.9414, GNorm = 1.0329, lr_0 = 9.4583e-04
Validation auc = 0.623181
Epoch 1090
Validation auc = 0.627378
Epoch 1091
Validation auc = 0.624980
Epoch 1092
Validation auc = 0.622417
Epoch 1093
Validation auc = 0.620836
Epoch 1094
Loss = 8.0335e-03, PNorm = 113.2115, GNorm = 0.1248, lr_0 = 9.4561e-04
Validation auc = 0.625089
Epoch 1095
Validation auc = 0.625797
Epoch 1096
Validation auc = 0.624707
Epoch 1097
Validation auc = 0.624489
Epoch 1098
Validation auc = 0.621927
Epoch 1099
Loss = 1.2389e-02, PNorm = 113.3413, GNorm = 0.2684, lr_0 = 9.4536e-04
Validation auc = 0.619855
Epoch 1100
Validation auc = 0.615712
Epoch 1101
Validation auc = 0.610860
Epoch 1102
Validation auc = 0.604318
Epoch 1103
Loss = 7.2651e-03, PNorm = 113.3940, GNorm = 0.0416, lr_0 = 9.4515e-04
Loss = 5.7291e-04, PNorm = 113.3977, GNorm = 0.0186, lr_0 = 9.4513e-04
Validation auc = 0.606716
Epoch 1104
Validation auc = 0.606880
Epoch 1105
Validation auc = 0.608025
Epoch 1106
Validation auc = 0.603664
Epoch 1107
Validation auc = 0.597776
Epoch 1108
Loss = 4.4572e-03, PNorm = 113.4489, GNorm = 0.2511, lr_0 = 9.4489e-04
Validation auc = 0.595322
Epoch 1109
Validation auc = 0.605681
Epoch 1110
Validation auc = 0.616638
Epoch 1111
Validation auc = 0.621545
Epoch 1112
Validation auc = 0.625252
Epoch 1113
Loss = 1.0156e-02, PNorm = 113.4846, GNorm = 0.4886, lr_0 = 9.4466e-04
Validation auc = 0.626615
Epoch 1114
Validation auc = 0.628741
Epoch 1115
Validation auc = 0.630268
Epoch 1116
Validation auc = 0.628687
Epoch 1117
Loss = 1.2432e-03, PNorm = 113.5070, GNorm = 0.0289, lr_0 = 9.4444e-04
Loss = 4.2318e-03, PNorm = 113.5089, GNorm = 0.2076, lr_0 = 9.4443e-04
Validation auc = 0.626724
Epoch 1118
Validation auc = 0.624598
Epoch 1119
Validation auc = 0.623453
Epoch 1120
Validation auc = 0.622526
Epoch 1121
Validation auc = 0.621109
Epoch 1122
Loss = 3.6435e-03, PNorm = 113.5338, GNorm = 0.2805, lr_0 = 9.4419e-04
Loss = 3.0734e-05, PNorm = 113.5354, GNorm = 0.0012, lr_0 = 9.4417e-04
Validation auc = 0.620400
Epoch 1123
Validation auc = 0.613913
Epoch 1124
Validation auc = 0.609442
Epoch 1125
Validation auc = 0.607698
Epoch 1126
Validation auc = 0.603609
Epoch 1127
Loss = 1.2383e-03, PNorm = 113.5573, GNorm = 0.0484, lr_0 = 9.4396e-04
Validation auc = 0.598266
Epoch 1128
Validation auc = 0.598812
Epoch 1129
Validation auc = 0.598866
Epoch 1130
Validation auc = 0.598539
Epoch 1131
Validation auc = 0.599248
Epoch 1132
Loss = 6.0091e-04, PNorm = 113.5894, GNorm = 0.0119, lr_0 = 9.4371e-04
Validation auc = 0.599575
Epoch 1133
Validation auc = 0.597885
Epoch 1134
Validation auc = 0.595813
Epoch 1135
Validation auc = 0.595377
Epoch 1136
Loss = 5.0115e-04, PNorm = 113.6079, GNorm = 0.0083, lr_0 = 9.4349e-04
Loss = 1.7652e-04, PNorm = 113.6088, GNorm = 0.0060, lr_0 = 9.4347e-04
Validation auc = 0.594614
Epoch 1137
Validation auc = 0.596413
Epoch 1138
Validation auc = 0.597558
Epoch 1139
Validation auc = 0.596740
Epoch 1140
Validation auc = 0.596522
Epoch 1141
Loss = 9.8225e-02, PNorm = 113.6289, GNorm = 0.7689, lr_0 = 9.4324e-04
Validation auc = 0.597285
Epoch 1142
Validation auc = 0.598212
Epoch 1143
Validation auc = 0.601047
Epoch 1144
Validation auc = 0.602573
Epoch 1145
Validation auc = 0.602137
Epoch 1146
Loss = 1.8527e-03, PNorm = 113.6580, GNorm = 0.0393, lr_0 = 9.4300e-04
Validation auc = 0.601210
Epoch 1147
Validation auc = 0.602628
Epoch 1148
Validation auc = 0.603009
Epoch 1149
Validation auc = 0.602846
Epoch 1150
Loss = 2.9901e-03, PNorm = 113.6819, GNorm = 0.0770, lr_0 = 9.4279e-04
Loss = 1.6569e-04, PNorm = 113.6835, GNorm = 0.0059, lr_0 = 9.4277e-04
Validation auc = 0.601265
Epoch 1151
Validation auc = 0.600338
Epoch 1152
Validation auc = 0.600011
Epoch 1153
Validation auc = 0.599902
Epoch 1154
Validation auc = 0.600283
Epoch 1155
Loss = 8.3193e-04, PNorm = 113.7003, GNorm = 0.0197, lr_0 = 9.4253e-04
Loss = 2.6583e-04, PNorm = 113.7012, GNorm = 0.0100, lr_0 = 9.4252e-04
Validation auc = 0.600011
Epoch 1156
Validation auc = 0.600011
Epoch 1157
Validation auc = 0.601374
Epoch 1158
Validation auc = 0.607098
Epoch 1159
Validation auc = 0.609442
Epoch 1160
Loss = 3.0282e-03, PNorm = 113.7193, GNorm = 0.1097, lr_0 = 9.4230e-04
Validation auc = 0.605245
Epoch 1161
Validation auc = 0.596576
Epoch 1162
Validation auc = 0.591615
Epoch 1163
Validation auc = 0.589489
Epoch 1164
Validation auc = 0.587254
Epoch 1165
Loss = 3.1505e-03, PNorm = 113.7839, GNorm = 0.0940, lr_0 = 9.4205e-04
Validation auc = 0.585128
Epoch 1166
Validation auc = 0.583329
Epoch 1167
Validation auc = 0.582947
Epoch 1168
Validation auc = 0.580985
Epoch 1169
Loss = 9.5032e-04, PNorm = 113.8162, GNorm = 0.0344, lr_0 = 9.4183e-04
Loss = 7.5498e-06, PNorm = 113.8178, GNorm = 0.0006, lr_0 = 9.4182e-04
Validation auc = 0.580494
Epoch 1170
Validation auc = 0.579186
Epoch 1171
Validation auc = 0.577986
Epoch 1172
Validation auc = 0.577550
Epoch 1173
Validation auc = 0.577277
Epoch 1174
Loss = 1.1270e-03, PNorm = 113.8339, GNorm = 0.0114, lr_0 = 9.4158e-04
Validation auc = 0.577059
Epoch 1175
Validation auc = 0.577059
Epoch 1176
Validation auc = 0.576950
Epoch 1177
Validation auc = 0.576242
Epoch 1178
Validation auc = 0.575642
Epoch 1179
Loss = 1.7022e-04, PNorm = 113.8439, GNorm = 0.0031, lr_0 = 9.4135e-04
Validation auc = 0.575206
Epoch 1180
Validation auc = 0.574388
Epoch 1181
Validation auc = 0.574279
Epoch 1182
Validation auc = 0.573734
Epoch 1183
Loss = 1.5924e-04, PNorm = 113.8500, GNorm = 0.0036, lr_0 = 9.4112e-04
Validation auc = 0.573352
Epoch 1184
Validation auc = 0.573025
Epoch 1185
Validation auc = 0.572916
Epoch 1186
Validation auc = 0.572698
Epoch 1187
Validation auc = 0.571226
Epoch 1188
Loss = 1.4312e-02, PNorm = 113.8545, GNorm = 0.5934, lr_0 = 9.4088e-04
Loss = 7.8859e-05, PNorm = 113.8553, GNorm = 0.0034, lr_0 = 9.4087e-04
Validation auc = 0.566211
Epoch 1189
Validation auc = 0.560541
Epoch 1190
Validation auc = 0.557324
Epoch 1191
Validation auc = 0.554380
Epoch 1192
Validation auc = 0.552908
Epoch 1193
Loss = 5.2655e-03, PNorm = 113.8675, GNorm = 0.4247, lr_0 = 9.4065e-04
Validation auc = 0.549365
Epoch 1194
Validation auc = 0.548329
Epoch 1195
Validation auc = 0.547893
Epoch 1196
Validation auc = 0.548656
Epoch 1197
Validation auc = 0.550074
Epoch 1198
Loss = 8.6045e-04, PNorm = 113.8834, GNorm = 0.0207, lr_0 = 9.4040e-04
Validation auc = 0.550673
Epoch 1199
Validation auc = 0.552200
Epoch 1200
Validation auc = 0.552908
Epoch 1201
Validation auc = 0.554762
Epoch 1202
Loss = 1.8400e-04, PNorm = 113.8954, GNorm = 0.0049, lr_0 = 9.4018e-04
Loss = 2.8748e-05, PNorm = 113.8966, GNorm = 0.0011, lr_0 = 9.4016e-04
Validation auc = 0.556016
Epoch 1203
Validation auc = 0.556179
Epoch 1204
Validation auc = 0.556725
Epoch 1205
Validation auc = 0.557052
Epoch 1206
Validation auc = 0.556343
Epoch 1207
Loss = 5.1495e-04, PNorm = 113.9164, GNorm = 0.0098, lr_0 = 9.3993e-04
Loss = 4.9132e-04, PNorm = 113.9181, GNorm = 0.0191, lr_0 = 9.3991e-04
Validation auc = 0.556507
Epoch 1208
Validation auc = 0.556452
Epoch 1209
Validation auc = 0.557651
Epoch 1210
Validation auc = 0.557815
Epoch 1211
Validation auc = 0.559232
Epoch 1212
Loss = 9.5265e-05, PNorm = 113.9314, GNorm = 0.0031, lr_0 = 9.3970e-04
Validation auc = 0.560704
Epoch 1213
Validation auc = 0.561468
Epoch 1214
Validation auc = 0.562885
Epoch 1215
Validation auc = 0.563267
Epoch 1216
Loss = 1.3172e-04, PNorm = 113.9415, GNorm = 0.0034, lr_0 = 9.3946e-04
Validation auc = 0.563866
Epoch 1217
Validation auc = 0.563975
Epoch 1218
Validation auc = 0.564193
Epoch 1219
Validation auc = 0.563921
Epoch 1220
Validation auc = 0.563921
Epoch 1221
Loss = 1.1968e-04, PNorm = 113.9485, GNorm = 0.0026, lr_0 = 9.3923e-04
Loss = 1.6788e-05, PNorm = 113.9488, GNorm = 0.0008, lr_0 = 9.3922e-04
Validation auc = 0.564030
Epoch 1222
Validation auc = 0.563975
Epoch 1223
Validation auc = 0.563485
Epoch 1224
Validation auc = 0.563430
Epoch 1225
Validation auc = 0.563376
Epoch 1226
Loss = 2.5470e-04, PNorm = 113.9527, GNorm = 0.0215, lr_0 = 9.3900e-04
Validation auc = 0.563539
Epoch 1227
Validation auc = 0.563812
Epoch 1228
Validation auc = 0.564684
Epoch 1229
Validation auc = 0.565774
Epoch 1230
Validation auc = 0.571117
Epoch 1231
Loss = 6.5264e-04, PNorm = 113.9614, GNorm = 0.0280, lr_0 = 9.3875e-04
Validation auc = 0.577441
Epoch 1232
Validation auc = 0.583710
Epoch 1233
Validation auc = 0.588835
Epoch 1234
Validation auc = 0.592706
Epoch 1235
Loss = 5.1376e-04, PNorm = 113.9906, GNorm = 0.0105, lr_0 = 9.3853e-04
Loss = 1.1881e-05, PNorm = 113.9924, GNorm = 0.0005, lr_0 = 9.3852e-04
Validation auc = 0.593632
Epoch 1236
Validation auc = 0.594232
Epoch 1237
Validation auc = 0.594505
Epoch 1238
Validation auc = 0.594014
Epoch 1239
Validation auc = 0.592433
Epoch 1240
Loss = 4.1740e-04, PNorm = 114.0090, GNorm = 0.0185, lr_0 = 9.3828e-04
Loss = 1.0354e-04, PNorm = 114.0096, GNorm = 0.0042, lr_0 = 9.3827e-04
Validation auc = 0.591561
Epoch 1241
Validation auc = 0.594614
Epoch 1242
Validation auc = 0.596467
Epoch 1243
Validation auc = 0.597122
Epoch 1244
Validation auc = 0.598157
Epoch 1245
Loss = 1.6257e-04, PNorm = 114.0140, GNorm = 0.0040, lr_0 = 9.3805e-04
Validation auc = 0.598757
Epoch 1246
Validation auc = 0.599738
Epoch 1247
Validation auc = 0.600174
Epoch 1248
Validation auc = 0.599956
Epoch 1249
Loss = 1.4887e-04, PNorm = 114.0190, GNorm = 0.0014, lr_0 = 9.3782e-04
Validation auc = 0.599738
Epoch 1250
Validation auc = 0.599357
Epoch 1251
Validation auc = 0.599357
Epoch 1252
Validation auc = 0.599193
Epoch 1253
Validation auc = 0.598757
Epoch 1254
Loss = 1.0574e-04, PNorm = 114.0250, GNorm = 0.0028, lr_0 = 9.3758e-04
Loss = 6.6557e-06, PNorm = 114.0254, GNorm = 0.0003, lr_0 = 9.3757e-04
Validation auc = 0.598484
Epoch 1255
Validation auc = 0.598375
Epoch 1256
Validation auc = 0.598048
Epoch 1257
Validation auc = 0.597994
Epoch 1258
Validation auc = 0.597994
Epoch 1259
Loss = 4.0788e-04, PNorm = 114.0291, GNorm = 0.0214, lr_0 = 9.3735e-04
Validation auc = 0.597721
Epoch 1260
Validation auc = 0.597667
Epoch 1261
Validation auc = 0.597449
Epoch 1262
Validation auc = 0.597885
Epoch 1263
Validation auc = 0.598321
Epoch 1264
Loss = 2.8051e-04, PNorm = 114.0288, GNorm = 0.0082, lr_0 = 9.3710e-04
Validation auc = 0.600665
Epoch 1265
Validation auc = 0.601810
Epoch 1266
Validation auc = 0.601919
Epoch 1267
Validation auc = 0.605190
Epoch 1268
Loss = 7.7143e-04, PNorm = 114.0505, GNorm = 0.0539, lr_0 = 9.3689e-04
Loss = 1.2914e-06, PNorm = 114.0540, GNorm = 0.0001, lr_0 = 9.3687e-04
Validation auc = 0.608461
Epoch 1269
Validation auc = 0.609061
Epoch 1270
Validation auc = 0.611241
Epoch 1271
Validation auc = 0.612877
Epoch 1272
Validation auc = 0.607316
Epoch 1273
Loss = 2.6077e-02, PNorm = 114.0988, GNorm = 0.6265, lr_0 = 9.3664e-04
Loss = 1.2477e-05, PNorm = 114.1076, GNorm = 0.0006, lr_0 = 9.3662e-04
Validation auc = 0.596358
Epoch 1274
Validation auc = 0.578531
Epoch 1275
Validation auc = 0.605135
Epoch 1276
Validation auc = 0.621381
Epoch 1277
Validation auc = 0.632830
Epoch 1278
Loss = 1.5090e-01, PNorm = 114.5285, GNorm = 4.1139, lr_0 = 9.3641e-04
Validation auc = 0.635338
Epoch 1279
Validation auc = 0.644006
Epoch 1280
Validation auc = 0.630159
Epoch 1281
Validation auc = 0.645369
Epoch 1282
Validation auc = 0.648912
Epoch 1283
Loss = 4.3495e-02, PNorm = 115.1192, GNorm = 0.5563, lr_0 = 9.3616e-04
Validation auc = 0.651148
Epoch 1284
Validation auc = 0.681513
Epoch 1285
Validation auc = 0.681513
Epoch 1286
Validation auc = 0.641335
Epoch 1287
Loss = 5.0585e-01, PNorm = 115.8632, GNorm = 1.8375, lr_0 = 9.3594e-04
Loss = 4.2641e-01, PNorm = 115.9571, GNorm = 2.8280, lr_0 = 9.3592e-04
Validation auc = 0.630050
Epoch 1288
Validation auc = 0.604318
Epoch 1289
Validation auc = 0.593142
Epoch 1290
Validation auc = 0.581257
Epoch 1291
Validation auc = 0.566647
Epoch 1292
Loss = 9.5615e-02, PNorm = 116.8769, GNorm = 0.8651, lr_0 = 9.3571e-04
Validation auc = 0.557924
Epoch 1293
Validation auc = 0.548329
Epoch 1294
Validation auc = 0.575751
Epoch 1295
Validation auc = 0.594123
Epoch 1296
Validation auc = 0.595213
Epoch 1297
Loss = 2.9098e-02, PNorm = 117.4844, GNorm = 0.4569, lr_0 = 9.3546e-04
Validation auc = 0.599520
Epoch 1298
Validation auc = 0.603991
Epoch 1299
Validation auc = 0.613422
Epoch 1300
Validation auc = 0.609551
Epoch 1301
Loss = 4.0384e-02, PNorm = 117.8434, GNorm = 0.3372, lr_0 = 9.3524e-04
Loss = 7.2839e-03, PNorm = 117.8617, GNorm = 0.2185, lr_0 = 9.3523e-04
Validation auc = 0.599738
Epoch 1302
Validation auc = 0.590634
Epoch 1303
Validation auc = 0.581584
Epoch 1304
Validation auc = 0.578804
Epoch 1305
Validation auc = 0.579240
Epoch 1306
Loss = 1.8884e-02, PNorm = 118.0325, GNorm = 1.5385, lr_0 = 9.3499e-04
Loss = 2.1484e-02, PNorm = 118.0422, GNorm = 0.3802, lr_0 = 9.3498e-04
Validation auc = 0.586273
Epoch 1307
Validation auc = 0.592978
Epoch 1308
Validation auc = 0.599629
Epoch 1309
Validation auc = 0.605899
Epoch 1310
Validation auc = 0.614458
Epoch 1311
Loss = 1.8745e-02, PNorm = 118.1426, GNorm = 0.7340, lr_0 = 9.3476e-04
Validation auc = 0.607153
Epoch 1312
Validation auc = 0.579186
Epoch 1313
Validation auc = 0.569918
Epoch 1314
Validation auc = 0.555471
Epoch 1315
Validation auc = 0.542060
Epoch 1316
Loss = 8.2824e-02, PNorm = 118.4891, GNorm = 0.9949, lr_0 = 9.3451e-04
Validation auc = 0.531974
Epoch 1317
Validation auc = 0.537208
Epoch 1318
Validation auc = 0.559341
Epoch 1319
Validation auc = 0.566538
Epoch 1320
Loss = 5.1551e-02, PNorm = 118.8010, GNorm = 0.4770, lr_0 = 9.3430e-04
Loss = 1.8220e-01, PNorm = 118.8224, GNorm = 7.2642, lr_0 = 9.3428e-04
Validation auc = 0.564521
Epoch 1321
Validation auc = 0.572698
Epoch 1322
Validation auc = 0.576242
Epoch 1323
Validation auc = 0.585455
Epoch 1324
Validation auc = 0.589598
Epoch 1325
Loss = 1.4006e-02, PNorm = 119.0898, GNorm = 0.1871, lr_0 = 9.3407e-04
Validation auc = 0.589925
Epoch 1326
Validation auc = 0.586927
Epoch 1327
Validation auc = 0.582620
Epoch 1328
Validation auc = 0.577659
Epoch 1329
Validation auc = 0.578313
Epoch 1330
Loss = 1.6744e-03, PNorm = 119.3057, GNorm = 0.0268, lr_0 = 9.3382e-04
Validation auc = 0.577768
Epoch 1331
Validation auc = 0.577059
Epoch 1332
Validation auc = 0.578095
Epoch 1333
Validation auc = 0.584038
Epoch 1334
Loss = 1.6493e-02, PNorm = 119.3937, GNorm = 0.0690, lr_0 = 9.3360e-04
Loss = 1.7365e-04, PNorm = 119.3997, GNorm = 0.0064, lr_0 = 9.3359e-04
Validation auc = 0.588072
Epoch 1335
Validation auc = 0.587145
Epoch 1336
Validation auc = 0.562122
Epoch 1337
Validation auc = 0.552145
Epoch 1338
Validation auc = 0.580112
Epoch 1339
Loss = 2.9054e-02, PNorm = 119.5325, GNorm = 0.6164, lr_0 = 9.3336e-04
Loss = 1.0653e-03, PNorm = 119.5536, GNorm = 0.0250, lr_0 = 9.3334e-04
Validation auc = 0.580821
Epoch 1340
Validation auc = 0.569700
Epoch 1341
Validation auc = 0.559450
Epoch 1342
Validation auc = 0.553781
Epoch 1343
Validation auc = 0.548602
Epoch 1344
Loss = 2.1094e-03, PNorm = 119.7545, GNorm = 0.0475, lr_0 = 9.3312e-04
Validation auc = 0.546857
Epoch 1345
Validation auc = 0.546912
Epoch 1346
Validation auc = 0.550019
Epoch 1347
Validation auc = 0.556179
Epoch 1348
Validation auc = 0.559941
Epoch 1349
Loss = 1.5536e-03, PNorm = 119.8855, GNorm = 0.0320, lr_0 = 9.3288e-04
Validation auc = 0.563485
Epoch 1350
Validation auc = 0.566429
Epoch 1351
Validation auc = 0.574443
Epoch 1352
Validation auc = 0.584092
Epoch 1353
Loss = 1.0214e-02, PNorm = 120.0346, GNorm = 0.3297, lr_0 = 9.3266e-04
Loss = 3.6970e-03, PNorm = 120.0492, GNorm = 0.0967, lr_0 = 9.3264e-04
Validation auc = 0.591125
Epoch 1354
Validation auc = 0.597012
Epoch 1355
Validation auc = 0.599302
Epoch 1356
Validation auc = 0.592160
Epoch 1357
Validation auc = 0.587199
Epoch 1358
Loss = 7.4346e-03, PNorm = 120.1983, GNorm = 0.2612, lr_0 = 9.3241e-04
Validation auc = 0.583928
Epoch 1359
Validation auc = 0.582129
Epoch 1360
Validation auc = 0.582457
Epoch 1361
Validation auc = 0.582129
Epoch 1362
Validation auc = 0.580821
Epoch 1363
Loss = 6.7896e-03, PNorm = 120.2921, GNorm = 0.4442, lr_0 = 9.3218e-04
Validation auc = 0.579731
Epoch 1364
Validation auc = 0.579186
Epoch 1365
Validation auc = 0.578204
Epoch 1366
Validation auc = 0.577496
Epoch 1367
Loss = 2.3692e-03, PNorm = 120.3411, GNorm = 0.0197, lr_0 = 9.3197e-04
Loss = 2.0079e-04, PNorm = 120.3440, GNorm = 0.0095, lr_0 = 9.3195e-04
Validation auc = 0.578095
Epoch 1368
Validation auc = 0.578477
Epoch 1369
Validation auc = 0.584528
Epoch 1370
Validation auc = 0.589380
Epoch 1371
Validation auc = 0.586218
Epoch 1372
Loss = 6.0660e-02, PNorm = 120.3902, GNorm = 0.0258, lr_0 = 9.3172e-04
Loss = 3.8817e-04, PNorm = 120.3999, GNorm = 0.0135, lr_0 = 9.3170e-04
Validation auc = 0.593033
Epoch 1373
Validation auc = 0.597830
Epoch 1374
Validation auc = 0.595050
Epoch 1375
Validation auc = 0.588235
Epoch 1376
Validation auc = 0.582020
Epoch 1377
Loss = 1.8798e-02, PNorm = 120.5050, GNorm = 0.4653, lr_0 = 9.3149e-04
Validation auc = 0.577386
Epoch 1378
Validation auc = 0.572862
Epoch 1379
Validation auc = 0.570735
Epoch 1380
Validation auc = 0.564957
Epoch 1381
Validation auc = 0.558033
Epoch 1382
Loss = 3.6542e-03, PNorm = 120.5798, GNorm = 0.0798, lr_0 = 9.3124e-04
Validation auc = 0.556452
Epoch 1383
Validation auc = 0.554871
Epoch 1384
Validation auc = 0.553072
Epoch 1385
Validation auc = 0.553345
Epoch 1386
Loss = 3.9367e-03, PNorm = 120.6159, GNorm = 0.0325, lr_0 = 9.3102e-04
Loss = 2.3010e-04, PNorm = 120.6176, GNorm = 0.0121, lr_0 = 9.3101e-04
Validation auc = 0.553236
Epoch 1387
Validation auc = 0.552745
Epoch 1388
Validation auc = 0.553781
Epoch 1389
Validation auc = 0.559232
Epoch 1390
Validation auc = 0.560977
Epoch 1391
Loss = 1.0980e-02, PNorm = 120.6497, GNorm = 0.0207, lr_0 = 9.3078e-04
Validation auc = 0.560432
Epoch 1392
Validation auc = 0.558905
Epoch 1393
Validation auc = 0.559232
Epoch 1394
Validation auc = 0.559614
Epoch 1395
Validation auc = 0.559832
Epoch 1396
Loss = 3.8939e-03, PNorm = 120.6878, GNorm = 0.0719, lr_0 = 9.3055e-04
Validation auc = 0.559778
Epoch 1397
Validation auc = 0.559941
Epoch 1398
Validation auc = 0.560050
Epoch 1399
Validation auc = 0.558415
Epoch 1400
Loss = 1.7445e-03, PNorm = 120.7152, GNorm = 0.0671, lr_0 = 9.3033e-04
Loss = 9.6341e-04, PNorm = 120.7193, GNorm = 0.0362, lr_0 = 9.3032e-04
Validation auc = 0.555307
Epoch 1401
Validation auc = 0.554326
Epoch 1402
Validation auc = 0.553399
Epoch 1403
Validation auc = 0.553454
Epoch 1404
Validation auc = 0.554653
Epoch 1405
Loss = 2.9957e-03, PNorm = 120.7786, GNorm = 0.0551, lr_0 = 9.3008e-04
Loss = 3.4637e-04, PNorm = 120.7821, GNorm = 0.0107, lr_0 = 9.3007e-04
Validation auc = 0.556125
Epoch 1406
Validation auc = 0.556725
Epoch 1407
Validation auc = 0.557433
Epoch 1408
Validation auc = 0.558851
Epoch 1409
Validation auc = 0.557924
Epoch 1410
Loss = 9.3205e-02, PNorm = 120.8139, GNorm = 0.6390, lr_0 = 9.2985e-04
Validation auc = 0.554326
Epoch 1411
Validation auc = 0.552690
Epoch 1412
Validation auc = 0.552745
Epoch 1413
Validation auc = 0.552963
Epoch 1414
Validation auc = 0.557597
Epoch 1415
Loss = 1.1672e-03, PNorm = 120.8357, GNorm = 0.0205, lr_0 = 9.2961e-04
Validation auc = 0.565447
Epoch 1416
Validation auc = 0.575097
Epoch 1417
Validation auc = 0.588344
Epoch 1418
Validation auc = 0.598975
Epoch 1419
Loss = 2.0996e-02, PNorm = 120.9168, GNorm = 0.6082, lr_0 = 9.2939e-04
Loss = 6.0690e-02, PNorm = 120.9285, GNorm = 2.0472, lr_0 = 9.2938e-04
Validation auc = 0.605626
Epoch 1420
Validation auc = 0.610860
Epoch 1421
Validation auc = 0.616475
Epoch 1422
Validation auc = 0.621927
Epoch 1423
Validation auc = 0.625416
Epoch 1424
Loss = 8.0797e-03, PNorm = 121.0588, GNorm = 0.1740, lr_0 = 9.2914e-04
Validation auc = 0.628305
Epoch 1425
Validation auc = 0.638827
Epoch 1426
Validation auc = 0.644169
Epoch 1427
Validation auc = 0.644497
Epoch 1428
Validation auc = 0.641771
Epoch 1429
Loss = 8.7925e-03, PNorm = 121.1467, GNorm = 0.1701, lr_0 = 9.2891e-04
Validation auc = 0.640135
Epoch 1430
Validation auc = 0.638527
Epoch 1431
Validation auc = 0.636101
Epoch 1432
Validation auc = 0.636155
Epoch 1433
Loss = 2.3683e-03, PNorm = 121.2195, GNorm = 0.1248, lr_0 = 9.2868e-04
Validation auc = 0.635937
Epoch 1434
Validation auc = 0.635937
Epoch 1435
Validation auc = 0.622581
Epoch 1436
Validation auc = 0.610914
Epoch 1437
Validation auc = 0.604808
Epoch 1438
Loss = 5.7870e-03, PNorm = 121.2610, GNorm = 0.0566, lr_0 = 9.2845e-04
Loss = 8.8183e-04, PNorm = 121.2631, GNorm = 0.0236, lr_0 = 9.2844e-04
Validation auc = 0.608734
Epoch 1439
Validation auc = 0.611350
Epoch 1440
Validation auc = 0.614785
Epoch 1441
Validation auc = 0.617238
Epoch 1442
Validation auc = 0.619255
Epoch 1443
Loss = 4.6846e-04, PNorm = 121.2849, GNorm = 0.0073, lr_0 = 9.2822e-04
Validation auc = 0.618874
Epoch 1444
Validation auc = 0.619364
Epoch 1445
Validation auc = 0.620291
Epoch 1446
Validation auc = 0.620400
Epoch 1447
Validation auc = 0.616420
Epoch 1448
Loss = 4.9623e-03, PNorm = 121.3216, GNorm = 0.1143, lr_0 = 9.2798e-04
Validation auc = 0.614839
Epoch 1449
Validation auc = 0.612877
Epoch 1450
Validation auc = 0.610206
Epoch 1451
Validation auc = 0.607316
Epoch 1452
Loss = 4.0872e-03, PNorm = 121.3620, GNorm = 0.1136, lr_0 = 9.2776e-04
Loss = 5.6456e-04, PNorm = 121.3657, GNorm = 0.0216, lr_0 = 9.2775e-04
Validation auc = 0.605245
Epoch 1453
Validation auc = 0.603827
Epoch 1454
Validation auc = 0.603282
Epoch 1455
Validation auc = 0.602900
Epoch 1456
Validation auc = 0.602737
Epoch 1457
Loss = 1.7050e-03, PNorm = 121.4014, GNorm = 0.0145, lr_0 = 9.2752e-04
Loss = 4.2518e-03, PNorm = 121.4031, GNorm = 0.1644, lr_0 = 9.2750e-04
Validation auc = 0.602628
Epoch 1458
Validation auc = 0.602846
Epoch 1459
Validation auc = 0.601592
Epoch 1460
Validation auc = 0.600883
Epoch 1461
Validation auc = 0.599684
Epoch 1462
Loss = 4.8544e-04, PNorm = 121.4194, GNorm = 0.0078, lr_0 = 9.2729e-04
Validation auc = 0.599411
Epoch 1463
Validation auc = 0.598866
Epoch 1464
Validation auc = 0.598866
Epoch 1465
Validation auc = 0.598430
Epoch 1466
Loss = 5.5309e-04, PNorm = 121.4302, GNorm = 0.0046, lr_0 = 9.2706e-04
Validation auc = 0.598593
Epoch 1467
Validation auc = 0.598103
Epoch 1468
Validation auc = 0.598212
Epoch 1469
Validation auc = 0.597830
Epoch 1470
Validation auc = 0.597994
Epoch 1471
Loss = 2.8930e-04, PNorm = 121.4437, GNorm = 0.0042, lr_0 = 9.2683e-04
Loss = 1.7255e-03, PNorm = 121.4451, GNorm = 0.0404, lr_0 = 9.2681e-04
Validation auc = 0.597558
Epoch 1472
Validation auc = 0.597667
Epoch 1473
Validation auc = 0.597340
Epoch 1474
Validation auc = 0.597340
Epoch 1475
Validation auc = 0.597830
Epoch 1476
Loss = 1.4256e-04, PNorm = 121.4626, GNorm = 0.0027, lr_0 = 9.2660e-04
Validation auc = 0.597885
Epoch 1477
Validation auc = 0.597939
Epoch 1478
Validation auc = 0.598048
Epoch 1479
Validation auc = 0.598321
Epoch 1480
Validation auc = 0.600120
Epoch 1481
Loss = 1.9412e-04, PNorm = 121.4746, GNorm = 0.0039, lr_0 = 9.2635e-04
Validation auc = 0.601428
Epoch 1482
Validation auc = 0.602137
Epoch 1483
Validation auc = 0.602355
Epoch 1484
Validation auc = 0.602846
Epoch 1485
Loss = 2.5084e-04, PNorm = 121.4749, GNorm = 0.0052, lr_0 = 9.2614e-04
Loss = 2.5463e-04, PNorm = 121.4754, GNorm = 0.0094, lr_0 = 9.2612e-04
Validation auc = 0.603173
Epoch 1486
Validation auc = 0.603718
Epoch 1487
Validation auc = 0.603827
Epoch 1488
Validation auc = 0.603827
Epoch 1489
Validation auc = 0.603936
Epoch 1490
Loss = 4.7881e-04, PNorm = 121.4833, GNorm = 0.0127, lr_0 = 9.2589e-04
Loss = 2.9554e-04, PNorm = 121.4841, GNorm = 0.0141, lr_0 = 9.2587e-04
Validation auc = 0.604427
Epoch 1491
Validation auc = 0.604318
Epoch 1492
Validation auc = 0.604154
Epoch 1493
Validation auc = 0.604263
Epoch 1494
Validation auc = 0.604318
Epoch 1495
Loss = 9.8464e-05, PNorm = 121.4950, GNorm = 0.0025, lr_0 = 9.2566e-04
Validation auc = 0.601701
Epoch 1496
Validation auc = 0.600502
Epoch 1497
Validation auc = 0.599193
Epoch 1498
Validation auc = 0.598266
Epoch 1499
Loss = 3.8279e-04, PNorm = 121.5011, GNorm = 0.0095, lr_0 = 9.2543e-04
Validation auc = 0.598266
Epoch 1500
Validation auc = 0.597285
Epoch 1501
Validation auc = 0.596576
Epoch 1502
Validation auc = 0.596031
Epoch 1503
Validation auc = 0.595922
Epoch 1504
Loss = 6.4056e-02, PNorm = 121.5082, GNorm = 0.0050, lr_0 = 9.2520e-04
Loss = 1.0749e-05, PNorm = 121.5076, GNorm = 0.0004, lr_0 = 9.2518e-04
Validation auc = 0.593305
Epoch 1505
Validation auc = 0.592270
Epoch 1506
Validation auc = 0.592051
Epoch 1507
Validation auc = 0.591779
Epoch 1508
Validation auc = 0.591506
Epoch 1509
Loss = 1.4542e-03, PNorm = 121.5154, GNorm = 0.0309, lr_0 = 9.2497e-04
Validation auc = 0.592215
Epoch 1510
Validation auc = 0.593578
Epoch 1511
Validation auc = 0.593469
Epoch 1512
Validation auc = 0.593632
Epoch 1513
Validation auc = 0.593523
Epoch 1514
Loss = 1.6065e-03, PNorm = 121.5347, GNorm = 0.0372, lr_0 = 9.2472e-04
Validation auc = 0.595268
Epoch 1515
Validation auc = 0.595595
Epoch 1516
Validation auc = 0.595759
Epoch 1517
Validation auc = 0.596195
Epoch 1518
Loss = 3.9092e-02, PNorm = 121.5501, GNorm = 0.4874, lr_0 = 9.2451e-04
Loss = 8.1786e-05, PNorm = 121.5501, GNorm = 0.0033, lr_0 = 9.2449e-04
Validation auc = 0.595486
Epoch 1519
Validation auc = 0.595268
Epoch 1520
Validation auc = 0.594668
Epoch 1521
Validation auc = 0.594396
Epoch 1522
Validation auc = 0.594123
Epoch 1523
Loss = 3.7562e-04, PNorm = 121.5567, GNorm = 0.0122, lr_0 = 9.2427e-04
Loss = 4.4899e-05, PNorm = 121.5573, GNorm = 0.0017, lr_0 = 9.2425e-04
Validation auc = 0.593960
Epoch 1524
Validation auc = 0.592160
Epoch 1525
Validation auc = 0.591234
Epoch 1526
Validation auc = 0.590525
Epoch 1527
Validation auc = 0.590198
Epoch 1528
Loss = 2.3410e-03, PNorm = 121.5669, GNorm = 0.0591, lr_0 = 9.2404e-04
Validation auc = 0.589871
Epoch 1529
Validation auc = 0.590252
Epoch 1530
Validation auc = 0.591997
Epoch 1531
Validation auc = 0.592597
Epoch 1532
Validation auc = 0.593687
Epoch 1533
Loss = 2.1659e-03, PNorm = 121.5805, GNorm = 0.0440, lr_0 = 9.2379e-04
Validation auc = 0.593741
Epoch 1534
Validation auc = 0.594232
Epoch 1535
Validation auc = 0.594287
Epoch 1536
Validation auc = 0.594396
Epoch 1537
Loss = 1.6668e-03, PNorm = 121.5903, GNorm = 0.0030, lr_0 = 9.2358e-04
Loss = 2.8054e-04, PNorm = 121.5908, GNorm = 0.0091, lr_0 = 9.2356e-04
Validation auc = 0.594505
Epoch 1538
Validation auc = 0.594614
Epoch 1539
Validation auc = 0.594341
Epoch 1540
Validation auc = 0.594396
Epoch 1541
Validation auc = 0.594396
Epoch 1542
Loss = 6.4525e-05, PNorm = 121.5975, GNorm = 0.0016, lr_0 = 9.2335e-04
Validation auc = 0.594287
Epoch 1543
Validation auc = 0.597776
Epoch 1544
Validation auc = 0.600447
Epoch 1545
Validation auc = 0.602083
Epoch 1546
Validation auc = 0.603500
Epoch 1547
Loss = 6.4471e-04, PNorm = 121.6065, GNorm = 0.0136, lr_0 = 9.2310e-04
Validation auc = 0.604427
Epoch 1548
Validation auc = 0.605299
Epoch 1549
Validation auc = 0.605844
Epoch 1550
Validation auc = 0.606771
Epoch 1551
Loss = 5.6157e-04, PNorm = 121.6197, GNorm = 0.0054, lr_0 = 9.2289e-04
Loss = 1.0351e-05, PNorm = 121.6205, GNorm = 0.0008, lr_0 = 9.2287e-04
Validation auc = 0.607425
Epoch 1552
Validation auc = 0.607970
Epoch 1553
Validation auc = 0.608406
Epoch 1554
Validation auc = 0.608352
Epoch 1555
Validation auc = 0.608352
Epoch 1556
Loss = 2.8512e-02, PNorm = 121.6301, GNorm = 0.0010, lr_0 = 9.2264e-04
Loss = 2.6372e-04, PNorm = 121.6301, GNorm = 0.0086, lr_0 = 9.2263e-04
Validation auc = 0.606226
Epoch 1557
Validation auc = 0.605026
Epoch 1558
Validation auc = 0.604372
Epoch 1559
Validation auc = 0.603173
Epoch 1560
Validation auc = 0.602846
Epoch 1561
Loss = 2.0835e-04, PNorm = 121.6378, GNorm = 0.0062, lr_0 = 9.2242e-04
Validation auc = 0.603064
Epoch 1562
Validation auc = 0.603718
Epoch 1563
Validation auc = 0.604972
Epoch 1564
Validation auc = 0.605081
Epoch 1565
Validation auc = 0.605354
Epoch 1566
Loss = 3.6035e-04, PNorm = 121.6533, GNorm = 0.0085, lr_0 = 9.2217e-04
Validation auc = 0.605572
Epoch 1567
Validation auc = 0.605899
Epoch 1568
Validation auc = 0.606171
Epoch 1569
Validation auc = 0.605626
Epoch 1570
Loss = 7.4433e-05, PNorm = 121.6596, GNorm = 0.0011, lr_0 = 9.2196e-04
Loss = 3.0197e-05, PNorm = 121.6600, GNorm = 0.0012, lr_0 = 9.2194e-04
Validation auc = 0.605245
Epoch 1571
Validation auc = 0.604917
Epoch 1572
Validation auc = 0.604590
Epoch 1573
Validation auc = 0.604808
Epoch 1574
Validation auc = 0.604699
Epoch 1575
Loss = 1.1314e-04, PNorm = 121.6632, GNorm = 0.0039, lr_0 = 9.2173e-04
Validation auc = 0.605899
Epoch 1576
Validation auc = 0.607425
Epoch 1577
Validation auc = 0.608461
Epoch 1578
Validation auc = 0.608297
Epoch 1579
Validation auc = 0.608897
Epoch 1580
Loss = 1.8916e-04, PNorm = 121.6718, GNorm = 0.0036, lr_0 = 9.2148e-04
Validation auc = 0.609333
Epoch 1581
Validation auc = 0.609769
Epoch 1582
Validation auc = 0.610206
Epoch 1583
Validation auc = 0.609933
Epoch 1584
Loss = 4.0821e-04, PNorm = 121.6829, GNorm = 0.0036, lr_0 = 9.2127e-04
Loss = 6.0179e-04, PNorm = 121.6838, GNorm = 0.0173, lr_0 = 9.2125e-04
Validation auc = 0.609933
Epoch 1585
Validation auc = 0.610151
Epoch 1586
Validation auc = 0.610369
Epoch 1587
Validation auc = 0.609987
Epoch 1588
Validation auc = 0.610042
Epoch 1589
Loss = 1.3371e-04, PNorm = 121.6930, GNorm = 0.0031, lr_0 = 9.2103e-04
Loss = 1.3662e-03, PNorm = 121.6936, GNorm = 0.0367, lr_0 = 9.2101e-04
Validation auc = 0.609987
Epoch 1590
Validation auc = 0.609933
Epoch 1591
Validation auc = 0.609606
Epoch 1592
Validation auc = 0.609170
Epoch 1593
Validation auc = 0.608897
Epoch 1594
Loss = 6.9421e-05, PNorm = 121.6992, GNorm = 0.0015, lr_0 = 9.2080e-04
Validation auc = 0.608352
Epoch 1595
Validation auc = 0.608625
Epoch 1596
Validation auc = 0.608461
Epoch 1597
Validation auc = 0.608188
Epoch 1598
Validation auc = 0.608243
Epoch 1599
Loss = 2.4931e-04, PNorm = 121.7029, GNorm = 0.0057, lr_0 = 9.2055e-04
Validation auc = 0.608134
Epoch 1600
Validation auc = 0.608134
Epoch 1601
Validation auc = 0.607698
Epoch 1602
Validation auc = 0.607480
Epoch 1603
Loss = 4.5084e-04, PNorm = 121.7097, GNorm = 0.0554, lr_0 = 9.2034e-04
Loss = 1.1764e-04, PNorm = 121.7101, GNorm = 0.0028, lr_0 = 9.2032e-04
Validation auc = 0.606335
Epoch 1604
Validation auc = 0.605245
Epoch 1605
Validation auc = 0.604263
Epoch 1606
Validation auc = 0.603773
Epoch 1607
Validation auc = 0.603009
Epoch 1608
Loss = 8.9135e-05, PNorm = 121.7168, GNorm = 0.0032, lr_0 = 9.2010e-04
Validation auc = 0.603009
Epoch 1609
Validation auc = 0.603064
Epoch 1610
Validation auc = 0.602737
Epoch 1611
Validation auc = 0.602791
Epoch 1612
Validation auc = 0.602464
Epoch 1613
Loss = 9.6634e-05, PNorm = 121.7215, GNorm = 0.0026, lr_0 = 9.1987e-04
Validation auc = 0.602137
Epoch 1614
Validation auc = 0.601755
Epoch 1615
Validation auc = 0.601537
Epoch 1616
Validation auc = 0.601319
Epoch 1617
Loss = 4.8384e-05, PNorm = 121.7243, GNorm = 0.0006, lr_0 = 9.1966e-04
Loss = 2.8688e-05, PNorm = 121.7245, GNorm = 0.0017, lr_0 = 9.1964e-04
Validation auc = 0.601374
Epoch 1618
Validation auc = 0.604318
Epoch 1619
Validation auc = 0.602273
Epoch 1620
Validation auc = 0.602791
Epoch 1621
Validation auc = 0.605517
Epoch 1622
Loss = 1.1200e-03, PNorm = 121.7615, GNorm = 0.0119, lr_0 = 9.1941e-04
Loss = 9.0416e-05, PNorm = 121.7662, GNorm = 0.0032, lr_0 = 9.1939e-04
Validation auc = 0.600556
Epoch 1623
Validation auc = 0.597721
Epoch 1624
Validation auc = 0.596195
Epoch 1625
Validation auc = 0.595813
Epoch 1626
Validation auc = 0.591070
Epoch 1627
Loss = 5.8728e-04, PNorm = 121.8055, GNorm = 0.0209, lr_0 = 9.1918e-04
Validation auc = 0.586382
Epoch 1628
Validation auc = 0.582620
Epoch 1629
Validation auc = 0.580221
Epoch 1630
Validation auc = 0.578477
Epoch 1631
Validation auc = 0.577441
Epoch 1632
Loss = 3.3955e-03, PNorm = 121.8206, GNorm = 0.1597, lr_0 = 9.1894e-04
Validation auc = 0.576405
Epoch 1633
Validation auc = 0.576405
Epoch 1634
Validation auc = 0.575751
Epoch 1635
Validation auc = 0.576078
Epoch 1636
Loss = 1.9267e-04, PNorm = 121.8287, GNorm = 0.0050, lr_0 = 9.1873e-04
Loss = 3.2463e-05, PNorm = 121.8291, GNorm = 0.0016, lr_0 = 9.1871e-04
Validation auc = 0.576678
Epoch 1637
Validation auc = 0.577605
Epoch 1638
Validation auc = 0.577877
Epoch 1639
Validation auc = 0.578477
Epoch 1640
Validation auc = 0.577877
Epoch 1641
Loss = 2.1171e-04, PNorm = 121.8327, GNorm = 0.0059, lr_0 = 9.1848e-04
Validation auc = 0.577277
Epoch 1642
Validation auc = 0.576405
Epoch 1643
Validation auc = 0.577168
Epoch 1644
Validation auc = 0.578313
Epoch 1645
Validation auc = 0.579295
Epoch 1646
Loss = 3.0251e-04, PNorm = 121.8426, GNorm = 0.0124, lr_0 = 9.1825e-04
Validation auc = 0.579949
Epoch 1647
Validation auc = 0.581039
Epoch 1648
Validation auc = 0.581366
Epoch 1649
Validation auc = 0.581966
Epoch 1650
Loss = 1.2387e-04, PNorm = 121.8512, GNorm = 0.0036, lr_0 = 9.1804e-04
Loss = 4.3328e-05, PNorm = 121.8516, GNorm = 0.0017, lr_0 = 9.1803e-04
Validation auc = 0.582947
Epoch 1651
Validation auc = 0.583111
Epoch 1652
Validation auc = 0.583220
Epoch 1653
Validation auc = 0.583383
Epoch 1654
Validation auc = 0.583874
Epoch 1655
Loss = 8.6165e-04, PNorm = 121.8571, GNorm = 0.0016, lr_0 = 9.1780e-04
Loss = 8.0418e-05, PNorm = 121.8575, GNorm = 0.0033, lr_0 = 9.1778e-04
Validation auc = 0.584474
Epoch 1656
Validation auc = 0.584964
Epoch 1657
Validation auc = 0.585073
Epoch 1658
Validation auc = 0.585564
Epoch 1659
Validation auc = 0.585946
Epoch 1660
Loss = 6.1042e-05, PNorm = 121.8619, GNorm = 0.0015, lr_0 = 9.1757e-04
Validation auc = 0.586000
Epoch 1661
Validation auc = 0.583438
Epoch 1662
Validation auc = 0.576623
Epoch 1663
Validation auc = 0.574443
Epoch 1664
Validation auc = 0.574879
Epoch 1665
Loss = 5.1669e-03, PNorm = 121.8735, GNorm = 0.1715, lr_0 = 9.1733e-04
Validation auc = 0.576950
Epoch 1666
Validation auc = 0.582457
Epoch 1667
Validation auc = 0.583765
Epoch 1668
Validation auc = 0.584201
Epoch 1669
Loss = 1.5142e-04, PNorm = 121.8908, GNorm = 0.0038, lr_0 = 9.1712e-04
Loss = 3.2165e-05, PNorm = 121.8918, GNorm = 0.0014, lr_0 = 9.1710e-04
Validation auc = 0.584910
Epoch 1670
Validation auc = 0.585073
Epoch 1671
Validation auc = 0.585509
Epoch 1672
Validation auc = 0.585618
Epoch 1673
Validation auc = 0.585837
Epoch 1674
Loss = 1.1855e-04, PNorm = 121.9007, GNorm = 0.0018, lr_0 = 9.1687e-04
Validation auc = 0.586000
Epoch 1675
Validation auc = 0.586000
Epoch 1676
Validation auc = 0.586164
Epoch 1677
Validation auc = 0.586273
Epoch 1678
Validation auc = 0.586436
Epoch 1679
Loss = 8.5315e-05, PNorm = 121.9055, GNorm = 0.0019, lr_0 = 9.1664e-04
Validation auc = 0.586600
Epoch 1680
Validation auc = 0.586709
Epoch 1681
Validation auc = 0.586654
Epoch 1682
Validation auc = 0.586818
Epoch 1683
Loss = 5.6809e-05, PNorm = 121.9084, GNorm = 0.0016, lr_0 = 9.1642e-04
Validation auc = 0.586927
Epoch 1684
Validation auc = 0.586927
Epoch 1685
Validation auc = 0.587036
Epoch 1686
Validation auc = 0.587036
Epoch 1687
Validation auc = 0.587036
Epoch 1688
Loss = 6.3900e-05, PNorm = 121.9103, GNorm = 0.0021, lr_0 = 9.1619e-04
Loss = 2.0266e-06, PNorm = 121.9105, GNorm = 0.0001, lr_0 = 9.1617e-04
Validation auc = 0.587036
Epoch 1689
Validation auc = 0.587090
Epoch 1690
Validation auc = 0.587036
Epoch 1691
Validation auc = 0.587199
Epoch 1692
Validation auc = 0.587145
Epoch 1693
Loss = 4.5728e-05, PNorm = 121.9118, GNorm = 0.0012, lr_0 = 9.1596e-04
Validation auc = 0.587199
Epoch 1694
Validation auc = 0.587090
Epoch 1695
Validation auc = 0.587090
Epoch 1696
Validation auc = 0.587090
Epoch 1697
Validation auc = 0.587145
Epoch 1698
Loss = 3.0319e-05, PNorm = 121.9134, GNorm = 0.0007, lr_0 = 9.1572e-04
Validation auc = 0.587199
Epoch 1699
Validation auc = 0.587309
Epoch 1700
Validation auc = 0.587199
Epoch 1701
Validation auc = 0.587254
Epoch 1702
Loss = 7.4539e-05, PNorm = 121.9146, GNorm = 0.0026, lr_0 = 9.1551e-04
Loss = 3.1392e-06, PNorm = 121.9147, GNorm = 0.0001, lr_0 = 9.1549e-04
Validation auc = 0.587363
Epoch 1703
Validation auc = 0.587199
Epoch 1704
Validation auc = 0.587199
Epoch 1705
Validation auc = 0.587254
Epoch 1706
Validation auc = 0.587254
Epoch 1707
Loss = 4.5048e-05, PNorm = 121.9160, GNorm = 0.0010, lr_0 = 9.1526e-04
Loss = 1.6728e-05, PNorm = 121.9161, GNorm = 0.0007, lr_0 = 9.1525e-04
Validation auc = 0.587145
Epoch 1708
Validation auc = 0.587090
Epoch 1709
Validation auc = 0.587036
Epoch 1710
Validation auc = 0.586981
Epoch 1711
Validation auc = 0.586872
Epoch 1712
Loss = 1.2149e-04, PNorm = 121.9172, GNorm = 0.0058, lr_0 = 9.1504e-04
Validation auc = 0.586818
Epoch 1713
Validation auc = 0.586654
Epoch 1714
Validation auc = 0.586600
Epoch 1715
Validation auc = 0.586545
Epoch 1716
Loss = 1.7115e-04, PNorm = 121.9182, GNorm = 0.0129, lr_0 = 9.1481e-04
Validation auc = 0.586545
Epoch 1717
Validation auc = 0.586600
Epoch 1718
Validation auc = 0.586436
Epoch 1719
Validation auc = 0.586654
Epoch 1720
Validation auc = 0.586872
Epoch 1721
Loss = 2.6347e-05, PNorm = 121.9202, GNorm = 0.0005, lr_0 = 9.1458e-04
Loss = 4.1798e-05, PNorm = 121.9203, GNorm = 0.0014, lr_0 = 9.1457e-04
Validation auc = 0.587036
Epoch 1722
Validation auc = 0.587199
Epoch 1723
Validation auc = 0.587254
Epoch 1724
Validation auc = 0.587199
Epoch 1725
Validation auc = 0.587254
Epoch 1726
Loss = 3.2493e-05, PNorm = 121.9218, GNorm = 0.0009, lr_0 = 9.1436e-04
Validation auc = 0.587418
Epoch 1727
Validation auc = 0.587363
Epoch 1728
Validation auc = 0.587309
Epoch 1729
Validation auc = 0.587309
Epoch 1730
Validation auc = 0.587363
Epoch 1731
Loss = 6.2163e-05, PNorm = 121.9231, GNorm = 0.0018, lr_0 = 9.1411e-04
Validation auc = 0.587472
Epoch 1732
Validation auc = 0.587527
Epoch 1733
Validation auc = 0.587418
Epoch 1734
Validation auc = 0.587527
Epoch 1735
Loss = 1.6098e-03, PNorm = 121.9245, GNorm = 0.0876, lr_0 = 9.1390e-04
Loss = 2.3842e-06, PNorm = 121.9248, GNorm = 0.0001, lr_0 = 9.1389e-04
Validation auc = 0.586927
Epoch 1736
Validation auc = 0.586491
Epoch 1737
Validation auc = 0.585946
Epoch 1738
Validation auc = 0.585728
Epoch 1739
Validation auc = 0.585618
Epoch 1740
Loss = 5.4565e-05, PNorm = 121.9283, GNorm = 0.0020, lr_0 = 9.1366e-04
Loss = 1.5516e-05, PNorm = 121.9285, GNorm = 0.0006, lr_0 = 9.1364e-04
Validation auc = 0.585346
Epoch 1741
Validation auc = 0.585182
Epoch 1742
Validation auc = 0.585128
Epoch 1743
Validation auc = 0.585346
Epoch 1744
Validation auc = 0.585400
Epoch 1745
Loss = 3.7439e-05, PNorm = 121.9315, GNorm = 0.0010, lr_0 = 9.1343e-04
Validation auc = 0.585564
Epoch 1746
Validation auc = 0.585782
Epoch 1747
Validation auc = 0.585455
Epoch 1748
Validation auc = 0.585455
Epoch 1749
Loss = 4.8842e-05, PNorm = 121.9348, GNorm = 0.0003, lr_0 = 9.1320e-04
Validation auc = 0.585400
Epoch 1750
Validation auc = 0.585455
Epoch 1751
Validation auc = 0.585564
Epoch 1752
Validation auc = 0.585509
Epoch 1753
Validation auc = 0.585509
Epoch 1754
Loss = 2.9462e-05, PNorm = 121.9371, GNorm = 0.0007, lr_0 = 9.1298e-04
Loss = 1.6589e-05, PNorm = 121.9372, GNorm = 0.0006, lr_0 = 9.1296e-04
Validation auc = 0.585455
Epoch 1755
Validation auc = 0.585564
Epoch 1756
Validation auc = 0.585346
Epoch 1757
Validation auc = 0.585237
Epoch 1758
Validation auc = 0.585346
Epoch 1759
Loss = 1.1679e-04, PNorm = 121.9398, GNorm = 0.0054, lr_0 = 9.1275e-04
Validation auc = 0.585346
Epoch 1760
Validation auc = 0.585182
Epoch 1761
Validation auc = 0.585182
Epoch 1762
Validation auc = 0.585073
Epoch 1763
Validation auc = 0.584964
Epoch 1764
Loss = 1.3882e-05, PNorm = 121.9417, GNorm = 0.0003, lr_0 = 9.1251e-04
Validation auc = 0.584910
Epoch 1765
Validation auc = 0.585019
Epoch 1766
Validation auc = 0.581121
Epoch 1767
Validation auc = 0.580985
Epoch 1768
Loss = 1.7501e-05, PNorm = 121.9431, GNorm = 0.0004, lr_0 = 9.1230e-04
Loss = 4.1799e-05, PNorm = 121.9432, GNorm = 0.0013, lr_0 = 9.1228e-04
Validation auc = 0.580930
Epoch 1769
Validation auc = 0.580712
Epoch 1770
Validation auc = 0.580712
Epoch 1771
Validation auc = 0.580821
Epoch 1772
Validation auc = 0.580767
Epoch 1773
Loss = 7.6083e-04, PNorm = 121.9445, GNorm = 0.0010, lr_0 = 9.1206e-04
Loss = 4.7683e-06, PNorm = 121.9444, GNorm = 0.0002, lr_0 = 9.1204e-04
Validation auc = 0.580085
Epoch 1774
Validation auc = 0.579022
Epoch 1775
Validation auc = 0.565257
Epoch 1776
Validation auc = 0.557624
Epoch 1777
Validation auc = 0.568200
Epoch 1778
Loss = 6.6492e-04, PNorm = 121.9532, GNorm = 0.0355, lr_0 = 9.1183e-04
Validation auc = 0.579240
Epoch 1779
Validation auc = 0.586545
Epoch 1780
Validation auc = 0.591179
Epoch 1781
Validation auc = 0.594750
Epoch 1782
Validation auc = 0.600120
Epoch 1783
Loss = 9.2733e-05, PNorm = 121.9785, GNorm = 0.0036, lr_0 = 9.1159e-04
Validation auc = 0.601810
Epoch 1784
Validation auc = 0.602791
Epoch 1785
Validation auc = 0.603991
Epoch 1786
Validation auc = 0.604645
Epoch 1787
Loss = 7.2112e-05, PNorm = 121.9881, GNorm = 0.0010, lr_0 = 9.1138e-04
Loss = 3.3805e-04, PNorm = 121.9887, GNorm = 0.0090, lr_0 = 9.1136e-04
Validation auc = 0.605135
Epoch 1788
Validation auc = 0.605517
Epoch 1789
Validation auc = 0.611378
Epoch 1790
Validation auc = 0.615712
Epoch 1791
Validation auc = 0.622581
Epoch 1792
Loss = 9.4839e-04, PNorm = 122.1025, GNorm = 0.0235, lr_0 = 9.1115e-04
Validation auc = 0.618165
Epoch 1793
Validation auc = 0.616475
Epoch 1794
Validation auc = 0.613967
Epoch 1795
Validation auc = 0.610805
Epoch 1796
Validation auc = 0.608788
Epoch 1797
Loss = 4.6507e-02, PNorm = 122.2844, GNorm = 0.7100, lr_0 = 9.1091e-04
Validation auc = 0.602028
Epoch 1798
Validation auc = 0.592160
Epoch 1799
Validation auc = 0.582184
Epoch 1800
Validation auc = 0.574715
Epoch 1801
Loss = 2.7090e-04, PNorm = 122.4302, GNorm = 0.0089, lr_0 = 9.1070e-04
Loss = 5.4239e-04, PNorm = 122.4390, GNorm = 0.0270, lr_0 = 9.1068e-04
Validation auc = 0.567246
Epoch 1802
Validation auc = 0.561686
Epoch 1803
Validation auc = 0.555471
Epoch 1804
Validation auc = 0.552036
Epoch 1805
Validation auc = 0.550455
Epoch 1806
Loss = 5.3221e-04, PNorm = 122.5076, GNorm = 0.0132, lr_0 = 9.1046e-04
Loss = 6.1123e-04, PNorm = 122.5126, GNorm = 0.0358, lr_0 = 9.1044e-04
Validation auc = 0.553017
Epoch 1807
Validation auc = 0.547511
Epoch 1808
Validation auc = 0.549201
Epoch 1809
Validation auc = 0.554435
Epoch 1810
Validation auc = 0.557542
Epoch 1811
Loss = 1.3471e-04, PNorm = 122.5574, GNorm = 0.0034, lr_0 = 9.1023e-04
Validation auc = 0.559723
Epoch 1812
Validation auc = 0.561086
Epoch 1813
Validation auc = 0.552799
Epoch 1814
Validation auc = 0.536553
Epoch 1815
Validation auc = 0.587472
Epoch 1816
Loss = 6.7375e-03, PNorm = 122.6095, GNorm = 0.2548, lr_0 = 9.0999e-04
Validation auc = 0.621927
Epoch 1817
Validation auc = 0.639808
Epoch 1818
Validation auc = 0.612277
Epoch 1819
Validation auc = 0.656872
Epoch 1820
Loss = 5.0013e-02, PNorm = 123.3309, GNorm = 2.0834, lr_0 = 9.0978e-04
Loss = 3.6564e-04, PNorm = 123.3923, GNorm = 0.0186, lr_0 = 9.0976e-04
Validation auc = 0.681840
Epoch 1821
Validation auc = 0.669411
Epoch 1822
Validation auc = 0.671537
Epoch 1823
Validation auc = 0.676389
Epoch 1824
Validation auc = 0.680641
Epoch 1825
Loss = 1.8051e-01, PNorm = 124.0759, GNorm = 2.9567, lr_0 = 9.0955e-04
Validation auc = 0.692035
Epoch 1826
Validation auc = 0.695306
Epoch 1827
Validation auc = 0.696178
Epoch 1828
Validation auc = 0.693889
Epoch 1829
Validation auc = 0.682331
Epoch 1830
Loss = 7.8142e-03, PNorm = 124.4995, GNorm = 0.2014, lr_0 = 9.0931e-04
Validation auc = 0.673881
Epoch 1831
Validation auc = 0.705446
Epoch 1832
Validation auc = 0.713896
Epoch 1833
Validation auc = 0.714660
Epoch 1834
Loss = 2.9914e-02, PNorm = 124.9286, GNorm = 1.1446, lr_0 = 9.0910e-04
Loss = 1.6908e-03, PNorm = 124.9588, GNorm = 0.0457, lr_0 = 9.0909e-04
Validation auc = 0.724200
Epoch 1835
Validation auc = 0.720493
Epoch 1836
Validation auc = 0.723491
Epoch 1837
Validation auc = 0.722892
Epoch 1838
Validation auc = 0.714987
Epoch 1839
Loss = 9.0545e-02, PNorm = 125.2987, GNorm = 0.8724, lr_0 = 9.0886e-04
Loss = 1.5123e-02, PNorm = 125.3177, GNorm = 0.5310, lr_0 = 9.0884e-04
Validation auc = 0.704029
Epoch 1840
Validation auc = 0.694597
Epoch 1841
Validation auc = 0.685275
Epoch 1842
Validation auc = 0.678297
Epoch 1843
Validation auc = 0.675789
Epoch 1844
Loss = 1.9733e-03, PNorm = 125.5047, GNorm = 0.0410, lr_0 = 9.0863e-04
Validation auc = 0.671101
Epoch 1845
Validation auc = 0.668157
Epoch 1846
Validation auc = 0.670174
Epoch 1847
Validation auc = 0.673172
Epoch 1848
Validation auc = 0.676770
Epoch 1849
Loss = 1.2450e-03, PNorm = 125.6600, GNorm = 0.0329, lr_0 = 9.0839e-04
Validation auc = 0.676716
Epoch 1850
Validation auc = 0.675898
Epoch 1851
Validation auc = 0.675789
Epoch 1852
Validation auc = 0.675189
Epoch 1853
Loss = 4.5834e-03, PNorm = 125.7572, GNorm = 0.0464, lr_0 = 9.0818e-04
Loss = 1.6658e-03, PNorm = 125.7621, GNorm = 0.0716, lr_0 = 9.0817e-04
Validation auc = 0.673990
Epoch 1854
Validation auc = 0.672682
Epoch 1855
Validation auc = 0.669847
Epoch 1856
Validation auc = 0.668157
Epoch 1857
Validation auc = 0.665376
Epoch 1858
Loss = 2.6707e-03, PNorm = 125.8428, GNorm = 0.0440, lr_0 = 9.0794e-04
Validation auc = 0.662814
Epoch 1859
Validation auc = 0.661778
Epoch 1860
Validation auc = 0.663414
Epoch 1861
Validation auc = 0.665213
Epoch 1862
Validation auc = 0.665922
Epoch 1863
Loss = 8.2107e-02, PNorm = 125.9079, GNorm = 1.6777, lr_0 = 9.0772e-04
Validation auc = 0.665376
Epoch 1864
Validation auc = 0.665922
Epoch 1865
Validation auc = 0.665813
Epoch 1866
Validation auc = 0.665267
Epoch 1867
Loss = 1.5490e-03, PNorm = 125.9708, GNorm = 0.0627, lr_0 = 9.0751e-04
Loss = 1.0778e-03, PNorm = 125.9743, GNorm = 0.0460, lr_0 = 9.0749e-04
Validation auc = 0.665049
Epoch 1868
Validation auc = 0.664831
Epoch 1869
Validation auc = 0.663577
Epoch 1870
Validation auc = 0.662269
Epoch 1871
Validation auc = 0.661233
Epoch 1872
Loss = 8.6587e-02, PNorm = 126.0117, GNorm = 0.9718, lr_0 = 9.0727e-04
Loss = 2.1185e-03, PNorm = 126.0133, GNorm = 0.0636, lr_0 = 9.0725e-04
Validation auc = 0.658562
Epoch 1873
Validation auc = 0.653110
Epoch 1874
Validation auc = 0.650439
Epoch 1875
Validation auc = 0.647277
Epoch 1876
Validation auc = 0.643679
Epoch 1877
Loss = 5.4150e-04, PNorm = 126.0654, GNorm = 0.0139, lr_0 = 9.0704e-04
Validation auc = 0.640680
Epoch 1878
Validation auc = 0.642970
Epoch 1879
Validation auc = 0.642697
Epoch 1880
Validation auc = 0.641825
Epoch 1881
Validation auc = 0.644006
Epoch 1882
Loss = 4.0282e-03, PNorm = 126.1523, GNorm = 0.1074, lr_0 = 9.0680e-04
Validation auc = 0.647004
Epoch 1883
Validation auc = 0.647931
Epoch 1884
Validation auc = 0.650112
Epoch 1885
Validation auc = 0.652074
Epoch 1886
Loss = 1.1105e-02, PNorm = 126.2318, GNorm = 0.1817, lr_0 = 9.0659e-04
Loss = 2.8951e-04, PNorm = 126.2365, GNorm = 0.0101, lr_0 = 9.0657e-04
Validation auc = 0.650820
Epoch 1887
Validation auc = 0.649676
Epoch 1888
Validation auc = 0.648858
Epoch 1889
Validation auc = 0.648313
Epoch 1890
Validation auc = 0.647386
Epoch 1891
Loss = 2.8394e-02, PNorm = 126.2816, GNorm = 0.0049, lr_0 = 9.0635e-04
Validation auc = 0.648531
Epoch 1892
Validation auc = 0.649948
Epoch 1893
Validation auc = 0.650330
Epoch 1894
Validation auc = 0.650384
Epoch 1895
Validation auc = 0.651202
Epoch 1896
Loss = 5.6149e-04, PNorm = 126.2997, GNorm = 0.0111, lr_0 = 9.0612e-04
Validation auc = 0.652456
Epoch 1897
Validation auc = 0.653764
Epoch 1898
Validation auc = 0.653328
Epoch 1899
Validation auc = 0.653328
Epoch 1900
Loss = 5.0266e-02, PNorm = 126.3172, GNorm = 1.3225, lr_0 = 9.0592e-04
Loss = 5.5293e-04, PNorm = 126.3181, GNorm = 0.0241, lr_0 = 9.0590e-04
Validation auc = 0.657308
Epoch 1901
Validation auc = 0.659052
Epoch 1902
Validation auc = 0.660034
Epoch 1903
Validation auc = 0.661015
Epoch 1904
Validation auc = 0.660524
Epoch 1905
Loss = 3.5134e-03, PNorm = 126.3492, GNorm = 0.2367, lr_0 = 9.0567e-04
Loss = 6.9115e-04, PNorm = 126.3524, GNorm = 0.0209, lr_0 = 9.0566e-04
Validation auc = 0.659162
Epoch 1906
Validation auc = 0.657799
Epoch 1907
Validation auc = 0.655127
Epoch 1908
Validation auc = 0.653165
Epoch 1909
Validation auc = 0.651856
Epoch 1910
Loss = 1.6218e-04, PNorm = 126.3806, GNorm = 0.0032, lr_0 = 9.0545e-04
Validation auc = 0.650930
Epoch 1911
Validation auc = 0.651039
Epoch 1912
Validation auc = 0.650439
Epoch 1913
Validation auc = 0.653001
Epoch 1914
Validation auc = 0.655127
Epoch 1915
Loss = 1.7753e-04, PNorm = 126.3908, GNorm = 0.0029, lr_0 = 9.0521e-04
Validation auc = 0.655945
Epoch 1916
Validation auc = 0.656163
Epoch 1917
Validation auc = 0.654473
Epoch 1918
Validation auc = 0.651802
Epoch 1919
Loss = 9.6584e-03, PNorm = 126.4092, GNorm = 0.2567, lr_0 = 9.0500e-04
Loss = 3.3817e-04, PNorm = 126.4113, GNorm = 0.0110, lr_0 = 9.0498e-04
Validation auc = 0.649349
Epoch 1920
Validation auc = 0.647168
Epoch 1921
Validation auc = 0.645369
Epoch 1922
Validation auc = 0.644660
Epoch 1923
Validation auc = 0.643842
Epoch 1924
Loss = 4.0560e-04, PNorm = 126.4379, GNorm = 0.0109, lr_0 = 9.0476e-04
Validation auc = 0.643406
Epoch 1925
Validation auc = 0.640353
Epoch 1926
Validation auc = 0.638936
Epoch 1927
Validation auc = 0.645532
Epoch 1928
Validation auc = 0.656436
Epoch 1929
Loss = 1.8312e-02, PNorm = 126.4900, GNorm = 0.5924, lr_0 = 9.0454e-04
Validation auc = 0.662814
Epoch 1930
Validation auc = 0.666194
Epoch 1931
Validation auc = 0.659489
Epoch 1932
Validation auc = 0.653928
Epoch 1933
Loss = 5.0309e-03, PNorm = 126.7994, GNorm = 0.0952, lr_0 = 9.0431e-04
Validation auc = 0.627160
Epoch 1934
Validation auc = 0.621272
Epoch 1935
Validation auc = 0.630377
Epoch 1936
Validation auc = 0.632339
Epoch 1937
Validation auc = 0.632067
Epoch 1938
Loss = 1.6774e-02, PNorm = 127.0600, GNorm = 0.6036, lr_0 = 9.0409e-04
Loss = 1.4606e-04, PNorm = 127.0719, GNorm = 0.0082, lr_0 = 9.0407e-04
Validation auc = 0.629450
Epoch 1939
Validation auc = 0.634465
Epoch 1940
Validation auc = 0.639263
Epoch 1941
Validation auc = 0.639808
Epoch 1942
Validation auc = 0.641335
Epoch 1943
Loss = 2.0341e-03, PNorm = 127.2182, GNorm = 0.0382, lr_0 = 9.0386e-04
Validation auc = 0.642425
Epoch 1944
Validation auc = 0.643134
Epoch 1945
Validation auc = 0.644224
Epoch 1946
Validation auc = 0.643570
Epoch 1947
Validation auc = 0.642425
Epoch 1948
Loss = 2.0863e-03, PNorm = 127.2876, GNorm = 0.0339, lr_0 = 9.0362e-04
Validation auc = 0.641989
Epoch 1949
Validation auc = 0.641771
Epoch 1950
Validation auc = 0.642207
Epoch 1951
Validation auc = 0.642534
Epoch 1952
Loss = 2.3226e-03, PNorm = 127.3205, GNorm = 0.0496, lr_0 = 9.0341e-04
Loss = 1.1961e-04, PNorm = 127.3229, GNorm = 0.0073, lr_0 = 9.0340e-04
Validation auc = 0.642316
Epoch 1953
Validation auc = 0.642425
Epoch 1954
Validation auc = 0.641825
Epoch 1955
Validation auc = 0.639590
Epoch 1956
Validation auc = 0.642152
Epoch 1957
Loss = 1.8375e-03, PNorm = 127.3554, GNorm = 0.1824, lr_0 = 9.0317e-04
Loss = 8.2903e-04, PNorm = 127.3578, GNorm = 0.0289, lr_0 = 9.0316e-04
Validation auc = 0.641607
Epoch 1958
Validation auc = 0.640299
Epoch 1959
Validation auc = 0.639590
Epoch 1960
Validation auc = 0.639263
Epoch 1961
Validation auc = 0.639045
Epoch 1962
Loss = 4.2059e-04, PNorm = 127.3820, GNorm = 0.0088, lr_0 = 9.0295e-04
Validation auc = 0.638990
Epoch 1963
Validation auc = 0.638718
Epoch 1964
Validation auc = 0.638064
Epoch 1965
Validation auc = 0.637845
Epoch 1966
Loss = 1.2474e-03, PNorm = 127.3930, GNorm = 0.0057, lr_0 = 9.0273e-04
Validation auc = 0.638445
Epoch 1967
Validation auc = 0.638336
Epoch 1968
Validation auc = 0.639045
Epoch 1969
Validation auc = 0.638663
Epoch 1970
Validation auc = 0.638881
Epoch 1971
Loss = 5.3750e-02, PNorm = 127.4081, GNorm = 0.0149, lr_0 = 9.0250e-04
Loss = 8.9765e-05, PNorm = 127.4089, GNorm = 0.0063, lr_0 = 9.0249e-04
Validation auc = 0.632830
Epoch 1972
Validation auc = 0.628687
Epoch 1973
Validation auc = 0.628905
Epoch 1974
Validation auc = 0.629341
Epoch 1975
Validation auc = 0.638445
Epoch 1976
Loss = 7.5540e-04, PNorm = 127.4290, GNorm = 0.0190, lr_0 = 9.0228e-04
Validation auc = 0.653492
Epoch 1977
Validation auc = 0.648367
Epoch 1978
Validation auc = 0.642643
Epoch 1979
Validation auc = 0.637900
Epoch 1980
Validation auc = 0.638391
Epoch 1981
Loss = 1.5098e-02, PNorm = 127.5001, GNorm = 0.5707, lr_0 = 9.0204e-04
Validation auc = 0.641771
Epoch 1982
Validation auc = 0.606335
Epoch 1983
Validation auc = 0.575969
Epoch 1984
Validation auc = 0.593905
Epoch 1985
Loss = 7.7178e-02, PNorm = 127.7979, GNorm = 0.1479, lr_0 = 9.0183e-04
Loss = 5.3834e-03, PNorm = 127.8269, GNorm = 0.1153, lr_0 = 9.0181e-04
Validation auc = 0.634411
Epoch 1986
Validation auc = 0.632721
Epoch 1987
Validation auc = 0.633593
Epoch 1988
Validation auc = 0.638064
Epoch 1989
Validation auc = 0.620291
Epoch 1990
Loss = 9.7820e-02, PNorm = 128.1900, GNorm = 0.4259, lr_0 = 9.0159e-04
Loss = 1.0125e-02, PNorm = 128.2161, GNorm = 0.2159, lr_0 = 9.0157e-04
Validation auc = 0.607698
Epoch 1991
Validation auc = 0.601919
Epoch 1992
Validation auc = 0.596958
Epoch 1993
Validation auc = 0.595213
Epoch 1994
Validation auc = 0.588508
Epoch 1995
Loss = 9.1445e-03, PNorm = 128.4925, GNorm = 0.0998, lr_0 = 9.0137e-04
Validation auc = 0.578368
Epoch 1996
Validation auc = 0.577823
Epoch 1997
Validation auc = 0.590525
Epoch 1998
Validation auc = 0.605081
Epoch 1999
Loss = 2.2366e-02, PNorm = 128.8281, GNorm = 0.4070, lr_0 = 9.0114e-04
Validation auc = 0.617347
Model 0 best validation auc = 0.727198 on epoch 520
Loading pretrained parameter "encoder.encoder.0.cached_zero_vector".
Loading pretrained parameter "encoder.encoder.0.W_i.weight".
Loading pretrained parameter "encoder.encoder.0.W_h.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.bias".
Loading pretrained parameter "ffn.1.weight".
Loading pretrained parameter "ffn.1.bias".
Moving model to cuda
Model 0 test auc = 0.678785
Ensemble test auc = 0.678785
Fold 8
Splitting data with seed 8
Class sizes
sars_cov_two_active 0: 98.39%, 1: 1.61%
Total size = 3,294 | train size = 3,294 | val size = 1,096 | test size = 1,086
With class_balance, effective train size = 106
Building model 0
MoleculeModel(
  (sigmoid): Sigmoid()
  (encoder): MPN(
    (encoder): ModuleList(
      (0): MPNEncoder(
        (dropout_layer): Dropout(p=0.05, inplace=False)
        (act_func): ReLU()
        (W_i): Linear(in_features=147, out_features=2100, bias=False)
        (W_h): Linear(in_features=2100, out_features=2100, bias=False)
        (W_o): Linear(in_features=2233, out_features=2100, bias=True)
      )
    )
  )
  (ffn): Sequential(
    (0): Dropout(p=0.05, inplace=False)
    (1): Linear(in_features=2328, out_features=1, bias=True)
  )
)
Number of parameters = 9,412,429
Moving model to cuda
Epoch 0
Validation auc = 0.463119
Epoch 1
Validation auc = 0.617020
Epoch 2
Validation auc = 0.567573
Epoch 3
Validation auc = 0.531701
Epoch 4
Loss = 6.9989e-01, PNorm = 67.4090, GNorm = 1.0144, lr_0 = 2.0385e-04
Loss = 5.9686e-01, PNorm = 67.4110, GNorm = 3.7205, lr_0 = 2.1077e-04
Validation auc = 0.593741
Epoch 5
Validation auc = 0.612441
Epoch 6
Validation auc = 0.622853
Epoch 7
Validation auc = 0.646459
Epoch 8
Validation auc = 0.608679
Epoch 9
Loss = 7.1792e-01, PNorm = 67.4460, GNorm = 2.0642, lr_0 = 3.0077e-04
Validation auc = 0.635174
Epoch 10
Validation auc = 0.635501
Epoch 11
Validation auc = 0.641880
Epoch 12
Validation auc = 0.646623
Epoch 13
Validation auc = 0.666848
Epoch 14
Loss = 6.0495e-01, PNorm = 67.5147, GNorm = 0.9076, lr_0 = 4.0462e-04
Validation auc = 0.685820
Epoch 15
Validation auc = 0.691872
Epoch 16
Validation auc = 0.671864
Epoch 17
Validation auc = 0.677370
Epoch 18
Loss = 6.2250e-01, PNorm = 67.6033, GNorm = 1.0433, lr_0 = 4.9462e-04
Loss = 6.6201e-01, PNorm = 67.6095, GNorm = 2.8416, lr_0 = 5.0154e-04
Validation auc = 0.679987
Epoch 19
Validation auc = 0.556398
Epoch 20
Validation auc = 0.657962
Epoch 21
Validation auc = 0.635283
Epoch 22
Validation auc = 0.651366
Epoch 23
Loss = 7.0320e-01, PNorm = 67.7606, GNorm = 1.2914, lr_0 = 5.9846e-04
Loss = 6.4246e-01, PNorm = 67.7755, GNorm = 3.1695, lr_0 = 6.0538e-04
Validation auc = 0.660633
Epoch 24
Validation auc = 0.665322
Epoch 25
Validation auc = 0.674426
Epoch 26
Validation auc = 0.666848
Epoch 27
Validation auc = 0.676171
Epoch 28
Loss = 5.9815e-01, PNorm = 67.9853, GNorm = 0.7002, lr_0 = 6.9538e-04
Validation auc = 0.686911
Epoch 29
Validation auc = 0.699286
Epoch 30
Validation auc = 0.675626
Epoch 31
Validation auc = 0.671537
Epoch 32
Validation auc = 0.647222
Epoch 33
Loss = 6.4103e-01, PNorm = 68.2500, GNorm = 0.9881, lr_0 = 7.9923e-04
Validation auc = 0.629941
Epoch 34
Validation auc = 0.637355
Epoch 35
Validation auc = 0.638772
Epoch 36
Validation auc = 0.639699
Epoch 37
Loss = 5.9657e-01, PNorm = 68.5119, GNorm = 0.6177, lr_0 = 8.8923e-04
Loss = 3.6579e-01, PNorm = 68.5382, GNorm = 1.8854, lr_0 = 8.9615e-04
Validation auc = 0.627269
Epoch 38
Validation auc = 0.633757
Epoch 39
Validation auc = 0.638500
Epoch 40
Validation auc = 0.653546
Epoch 41
Validation auc = 0.670283
Epoch 42
Loss = 6.0790e-01, PNorm = 68.8952, GNorm = 0.7705, lr_0 = 9.8615e-04
Validation auc = 0.663632
Epoch 43
Validation auc = 0.664886
Epoch 44
Validation auc = 0.656654
Epoch 45
Validation auc = 0.668211
Epoch 46
Validation auc = 0.660797
Epoch 47
Loss = 6.0581e-01, PNorm = 69.2721, GNorm = 0.8412, lr_0 = 9.9977e-04
Validation auc = 0.626452
Epoch 48
Validation auc = 0.611950
Epoch 49
Validation auc = 0.624652
Epoch 50
Validation auc = 0.651584
Epoch 51
Loss = 5.8245e-01, PNorm = 69.5648, GNorm = 0.9226, lr_0 = 9.9954e-04
Loss = 5.8123e-01, PNorm = 69.5864, GNorm = 2.0878, lr_0 = 9.9952e-04
Validation auc = 0.661778
Epoch 52
Validation auc = 0.654201
Epoch 53
Validation auc = 0.643352
Epoch 54
Validation auc = 0.648422
Epoch 55
Validation auc = 0.655672
Epoch 56
Loss = 6.1220e-01, PNorm = 69.9069, GNorm = 1.0272, lr_0 = 9.9927e-04
Loss = 9.6709e-01, PNorm = 69.9282, GNorm = 3.3180, lr_0 = 9.9926e-04
Validation auc = 0.636755
Epoch 57
Validation auc = 0.613967
Epoch 58
Validation auc = 0.605081
Epoch 59
Validation auc = 0.598812
Epoch 60
Validation auc = 0.609933
Epoch 61
Loss = 5.5922e-01, PNorm = 70.3170, GNorm = 1.0613, lr_0 = 9.9903e-04
Validation auc = 0.637736
Epoch 62
Validation auc = 0.627106
Epoch 63
Validation auc = 0.640571
Epoch 64
Validation auc = 0.644278
Epoch 65
Validation auc = 0.596413
Epoch 66
Loss = 7.0525e-01, PNorm = 70.7817, GNorm = 6.0727, lr_0 = 9.9876e-04
Validation auc = 0.633157
Epoch 67
Validation auc = 0.644606
Epoch 68
Validation auc = 0.630813
Epoch 69
Validation auc = 0.612005
Epoch 70
Loss = 5.8640e-01, PNorm = 71.2832, GNorm = 1.6874, lr_0 = 9.9853e-04
Loss = 4.1894e-01, PNorm = 71.3189, GNorm = 1.4839, lr_0 = 9.9851e-04
Validation auc = 0.624216
Epoch 71
Validation auc = 0.615930
Epoch 72
Validation auc = 0.588017
Epoch 73
Validation auc = 0.588181
Epoch 74
Validation auc = 0.645151
Epoch 75
Loss = 5.9181e-01, PNorm = 71.7753, GNorm = 1.4868, lr_0 = 9.9828e-04
Validation auc = 0.643897
Epoch 76
Validation auc = 0.636592
Epoch 77
Validation auc = 0.661669
Epoch 78
Validation auc = 0.620618
Epoch 79
Validation auc = 0.657090
Epoch 80
Loss = 3.9502e-01, PNorm = 72.3626, GNorm = 0.7620, lr_0 = 9.9802e-04
Validation auc = 0.663359
Epoch 81
Validation auc = 0.656327
Epoch 82
Validation auc = 0.679714
Epoch 83
Validation auc = 0.652074
Epoch 84
Loss = 5.0765e-01, PNorm = 72.9240, GNorm = 1.6074, lr_0 = 9.9779e-04
Loss = 6.6623e-01, PNorm = 72.9789, GNorm = 5.1871, lr_0 = 9.9777e-04
Validation auc = 0.608516
Epoch 85
Validation auc = 0.641553
Epoch 86
Validation auc = 0.655563
Epoch 87
Validation auc = 0.655618
Epoch 88
Validation auc = 0.674426
Epoch 89
Loss = 3.7346e-01, PNorm = 73.7549, GNorm = 1.6973, lr_0 = 9.9752e-04
Loss = 5.1403e-01, PNorm = 73.7975, GNorm = 4.6371, lr_0 = 9.9750e-04
Validation auc = 0.654310
Epoch 90
Validation auc = 0.628850
Epoch 91
Validation auc = 0.644497
Epoch 92
Validation auc = 0.667884
Epoch 93
Validation auc = 0.666412
Epoch 94
Loss = 3.1712e-01, PNorm = 74.4774, GNorm = 1.1753, lr_0 = 9.9727e-04
Validation auc = 0.671155
Epoch 95
Validation auc = 0.599793
Epoch 96
Validation auc = 0.578913
Epoch 97
Validation auc = 0.636864
Epoch 98
Validation auc = 0.630213
Epoch 99
Loss = 3.8353e-01, PNorm = 75.2886, GNorm = 2.5989, lr_0 = 9.9701e-04
Validation auc = 0.665376
Epoch 100
Validation auc = 0.677316
Epoch 101
Validation auc = 0.650493
Epoch 102
Validation auc = 0.626452
Epoch 103
Loss = 2.1661e-01, PNorm = 75.9280, GNorm = 0.5663, lr_0 = 9.9678e-04
Loss = 2.0475e-01, PNorm = 75.9719, GNorm = 1.7658, lr_0 = 9.9676e-04
Validation auc = 0.636101
Epoch 104
Validation auc = 0.636483
Epoch 105
Validation auc = 0.578041
Epoch 106
Validation auc = 0.613858
Epoch 107
Validation auc = 0.633648
Epoch 108
Loss = 2.7636e-01, PNorm = 76.6031, GNorm = 0.9468, lr_0 = 9.9651e-04
Validation auc = 0.646514
Epoch 109
Validation auc = 0.635937
Epoch 110
Validation auc = 0.608243
Epoch 111
Validation auc = 0.578259
Epoch 112
Validation auc = 0.594668
Epoch 113
Loss = 5.3911e-01, PNorm = 77.4533, GNorm = 3.7932, lr_0 = 9.9627e-04
Validation auc = 0.580767
Epoch 114
Validation auc = 0.627978
Epoch 115
Validation auc = 0.645914
Epoch 116
Validation auc = 0.641389
Epoch 117
Loss = 1.8192e-01, PNorm = 78.2855, GNorm = 0.8593, lr_0 = 9.9604e-04
Loss = 1.0089e-01, PNorm = 78.3482, GNorm = 0.9113, lr_0 = 9.9602e-04
Validation auc = 0.627869
Epoch 118
Validation auc = 0.610478
Epoch 119
Validation auc = 0.597830
Epoch 120
Validation auc = 0.590198
Epoch 121
Validation auc = 0.566756
Epoch 122
Loss = 2.9799e-01, PNorm = 79.1006, GNorm = 1.0174, lr_0 = 9.9577e-04
Loss = 1.5150e-01, PNorm = 79.1605, GNorm = 2.5595, lr_0 = 9.9575e-04
Validation auc = 0.583601
Epoch 123
Validation auc = 0.580112
Epoch 124
Validation auc = 0.615058
Epoch 125
Validation auc = 0.619446
Epoch 126
Validation auc = 0.645042
Epoch 127
Loss = 4.1395e-01, PNorm = 79.8723, GNorm = 6.4145, lr_0 = 9.9552e-04
Validation auc = 0.651420
Epoch 128
Validation auc = 0.639972
Epoch 129
Validation auc = 0.660688
Epoch 130
Validation auc = 0.632285
Epoch 131
Validation auc = 0.597776
Epoch 132
Loss = 1.1139e-01, PNorm = 80.6338, GNorm = 0.8049, lr_0 = 9.9526e-04
Validation auc = 0.630050
Epoch 133
Validation auc = 0.656981
Epoch 134
Validation auc = 0.626179
Epoch 135
Validation auc = 0.628523
Epoch 136
Loss = 9.9111e-02, PNorm = 81.2147, GNorm = 0.4874, lr_0 = 9.9503e-04
Loss = 2.9851e-02, PNorm = 81.2543, GNorm = 0.5552, lr_0 = 9.9501e-04
Validation auc = 0.647495
Epoch 137
Validation auc = 0.659216
Epoch 138
Validation auc = 0.635719
Epoch 139
Validation auc = 0.622962
Epoch 140
Validation auc = 0.639917
Epoch 141
Loss = 2.4621e-01, PNorm = 81.7164, GNorm = 1.9178, lr_0 = 9.9477e-04
Validation auc = 0.614730
Epoch 142
Validation auc = 0.631467
Epoch 143
Validation auc = 0.619092
Epoch 144
Validation auc = 0.585400
Epoch 145
Validation auc = 0.626942
Epoch 146
Loss = 4.2882e-01, PNorm = 82.4761, GNorm = 1.0905, lr_0 = 9.9452e-04
Validation auc = 0.651693
Epoch 147
Validation auc = 0.647877
Epoch 148
Validation auc = 0.642098
Epoch 149
Validation auc = 0.653165
Epoch 150
Loss = 2.7007e-01, PNorm = 83.1291, GNorm = 1.4732, lr_0 = 9.9429e-04
Loss = 1.0090e-01, PNorm = 83.1672, GNorm = 1.3598, lr_0 = 9.9427e-04
Validation auc = 0.658289
Epoch 151
Validation auc = 0.652947
Epoch 152
Validation auc = 0.647986
Epoch 153
Validation auc = 0.654091
Epoch 154
Validation auc = 0.659271
Epoch 155
Loss = 1.1856e-01, PNorm = 83.6241, GNorm = 0.5305, lr_0 = 9.9403e-04
Loss = 3.3681e-01, PNorm = 83.6630, GNorm = 7.1037, lr_0 = 9.9401e-04
Validation auc = 0.662105
Epoch 156
Validation auc = 0.651802
Epoch 157
Validation auc = 0.639372
Epoch 158
Validation auc = 0.641389
Epoch 159
Validation auc = 0.622908
Epoch 160
Loss = 2.3772e-01, PNorm = 84.1722, GNorm = 1.4480, lr_0 = 9.9378e-04
Validation auc = 0.604100
Epoch 161
Validation auc = 0.618492
Epoch 162
Validation auc = 0.606226
Epoch 163
Validation auc = 0.616148
Epoch 164
Validation auc = 0.627869
Epoch 165
Loss = 1.2390e-01, PNorm = 84.7924, GNorm = 0.8237, lr_0 = 9.9351e-04
Validation auc = 0.628305
Epoch 166
Validation auc = 0.631249
Epoch 167
Validation auc = 0.620727
Epoch 168
Validation auc = 0.617565
Epoch 169
Loss = 1.2962e-01, PNorm = 85.3306, GNorm = 0.6796, lr_0 = 9.9329e-04
Loss = 1.1566e-01, PNorm = 85.3726, GNorm = 1.6822, lr_0 = 9.9327e-04
Validation auc = 0.618274
Epoch 170
Validation auc = 0.611787
Epoch 171
Validation auc = 0.608625
Epoch 172
Validation auc = 0.594450
Epoch 173
Validation auc = 0.574661
Epoch 174
Loss = 9.9523e-02, PNorm = 85.8060, GNorm = 0.3944, lr_0 = 9.9302e-04
Validation auc = 0.573352
Epoch 175
Validation auc = 0.581966
Epoch 176
Validation auc = 0.593796
Epoch 177
Validation auc = 0.632176
Epoch 178
Validation auc = 0.638936
Epoch 179
Loss = 3.8949e-02, PNorm = 86.1420, GNorm = 0.5207, lr_0 = 9.9277e-04
Validation auc = 0.637900
Epoch 180
Validation auc = 0.640517
Epoch 181
Validation auc = 0.634302
Epoch 182
Validation auc = 0.629014
Epoch 183
Loss = 8.6511e-02, PNorm = 86.4537, GNorm = 1.1226, lr_0 = 9.9253e-04
Validation auc = 0.625034
Epoch 184
Validation auc = 0.615766
Epoch 185
Validation auc = 0.613913
Epoch 186
Validation auc = 0.614621
Epoch 187
Validation auc = 0.632939
Epoch 188
Loss = 2.3306e-01, PNorm = 86.6997, GNorm = 3.6434, lr_0 = 9.9228e-04
Loss = 8.1958e-02, PNorm = 86.7089, GNorm = 1.8733, lr_0 = 9.9226e-04
Validation auc = 0.618601
Epoch 189
Validation auc = 0.614676
Epoch 190
Validation auc = 0.609933
Epoch 191
Validation auc = 0.602192
Epoch 192
Validation auc = 0.614349
Epoch 193
Loss = 4.2894e-02, PNorm = 86.9203, GNorm = 0.3636, lr_0 = 9.9204e-04
Validation auc = 0.615385
Epoch 194
Validation auc = 0.609551
Epoch 195
Validation auc = 0.607916
Epoch 196
Validation auc = 0.607153
Epoch 197
Validation auc = 0.604263
Epoch 198
Loss = 2.6142e-01, PNorm = 87.2307, GNorm = 2.0083, lr_0 = 9.9177e-04
Validation auc = 0.604263
Epoch 199
Validation auc = 0.608025
Epoch 200
Validation auc = 0.611623
Epoch 201
Validation auc = 0.619582
Epoch 202
Loss = 6.0603e-02, PNorm = 87.4430, GNorm = 0.8297, lr_0 = 9.9154e-04
Loss = 1.0204e-01, PNorm = 87.4602, GNorm = 1.3426, lr_0 = 9.9153e-04
Validation auc = 0.627814
Epoch 203
Validation auc = 0.628414
Epoch 204
Validation auc = 0.632994
Epoch 205
Validation auc = 0.636646
Epoch 206
Validation auc = 0.637791
Epoch 207
Loss = 4.9377e-02, PNorm = 87.6569, GNorm = 0.7551, lr_0 = 9.9128e-04
Loss = 7.5573e-03, PNorm = 87.6663, GNorm = 0.2931, lr_0 = 9.9126e-04
Validation auc = 0.641117
Epoch 208
Validation auc = 0.643788
Epoch 209
Validation auc = 0.652565
Epoch 210
Validation auc = 0.662433
Epoch 211
Validation auc = 0.662214
Epoch 212
Loss = 3.1782e-02, PNorm = 87.7895, GNorm = 0.4104, lr_0 = 9.9103e-04
Validation auc = 0.659434
Epoch 213
Validation auc = 0.654528
Epoch 214
Validation auc = 0.646514
Epoch 215
Validation auc = 0.641607
Epoch 216
Loss = 4.3204e-02, PNorm = 87.8932, GNorm = 0.0745, lr_0 = 9.9079e-04
Validation auc = 0.639372
Epoch 217
Validation auc = 0.640408
Epoch 218
Validation auc = 0.638663
Epoch 219
Validation auc = 0.642207
Epoch 220
Validation auc = 0.659870
Epoch 221
Loss = 3.5418e-02, PNorm = 88.0092, GNorm = 0.2123, lr_0 = 9.9054e-04
Loss = 6.1719e-03, PNorm = 88.0245, GNorm = 0.0974, lr_0 = 9.9052e-04
Validation auc = 0.666194
Epoch 222
Validation auc = 0.676934
Epoch 223
Validation auc = 0.666031
Epoch 224
Validation auc = 0.649785
Epoch 225
Validation auc = 0.651911
Epoch 226
Loss = 1.4932e-01, PNorm = 88.2811, GNorm = 2.3459, lr_0 = 9.9030e-04
Validation auc = 0.669901
Epoch 227
Validation auc = 0.683694
Epoch 228
Validation auc = 0.711007
Epoch 229
Validation auc = 0.713924
Epoch 230
Validation auc = 0.712343
Epoch 231
Loss = 2.1007e-01, PNorm = 89.2253, GNorm = 0.7133, lr_0 = 9.9003e-04
Validation auc = 0.710898
Epoch 232
Validation auc = 0.702148
Epoch 233
Validation auc = 0.688846
Epoch 234
Validation auc = 0.677724
Epoch 235
Loss = 1.2247e-01, PNorm = 89.7345, GNorm = 1.5627, lr_0 = 9.8980e-04
Loss = 6.2811e-02, PNorm = 89.7654, GNorm = 2.3197, lr_0 = 9.8979e-04
Validation auc = 0.665894
Epoch 236
Validation auc = 0.636701
Epoch 237
Validation auc = 0.620291
Epoch 238
Validation auc = 0.613967
Epoch 239
Validation auc = 0.614240
Epoch 240
Loss = 8.6170e-02, PNorm = 90.1978, GNorm = 1.0739, lr_0 = 9.8954e-04
Loss = 7.5633e-03, PNorm = 90.2260, GNorm = 0.2001, lr_0 = 9.8952e-04
Validation auc = 0.606171
Epoch 241
Validation auc = 0.589653
Epoch 242
Validation auc = 0.606226
Epoch 243
Validation auc = 0.620891
Epoch 244
Validation auc = 0.627215
Epoch 245
Loss = 3.2275e-01, PNorm = 90.7906, GNorm = 4.2952, lr_0 = 9.8930e-04
Validation auc = 0.656054
Epoch 246
Validation auc = 0.646132
Epoch 247
Validation auc = 0.649512
Epoch 248
Validation auc = 0.635883
Epoch 249
Loss = 4.8325e-02, PNorm = 91.4858, GNorm = 0.5466, lr_0 = 9.8905e-04
Validation auc = 0.620782
Epoch 250
Validation auc = 0.616311
Epoch 251
Validation auc = 0.600856
Epoch 252
Validation auc = 0.595159
Epoch 253
Validation auc = 0.589380
Epoch 254
Loss = 1.2152e-01, PNorm = 91.8654, GNorm = 0.8805, lr_0 = 9.8880e-04
Loss = 4.0786e-03, PNorm = 91.8861, GNorm = 0.1293, lr_0 = 9.8879e-04
Validation auc = 0.595541
Epoch 255
Validation auc = 0.595731
Epoch 256
Validation auc = 0.594205
Epoch 257
Validation auc = 0.597530
Epoch 258
Validation auc = 0.591343
Epoch 259
Loss = 4.3664e-02, PNorm = 92.1304, GNorm = 0.6192, lr_0 = 9.8856e-04
Validation auc = 0.592379
Epoch 260
Validation auc = 0.600338
Epoch 261
Validation auc = 0.574334
Epoch 262
Validation auc = 0.568773
Epoch 263
Validation auc = 0.599956
Epoch 264
Loss = 1.4831e-01, PNorm = 92.6035, GNorm = 1.6058, lr_0 = 9.8830e-04
Validation auc = 0.608352
Epoch 265
Validation auc = 0.613749
Epoch 266
Validation auc = 0.624216
Epoch 267
Validation auc = 0.631576
Epoch 268
Loss = 8.0752e-02, PNorm = 93.0308, GNorm = 0.5812, lr_0 = 9.8807e-04
Loss = 2.2813e-03, PNorm = 93.0558, GNorm = 0.0476, lr_0 = 9.8805e-04
Validation auc = 0.644115
Epoch 269
Validation auc = 0.651202
Epoch 270
Validation auc = 0.662214
Epoch 271
Validation auc = 0.663196
Epoch 272
Validation auc = 0.655509
Epoch 273
Loss = 4.7029e-02, PNorm = 93.3151, GNorm = 0.1594, lr_0 = 9.8781e-04
Loss = 1.5586e-02, PNorm = 93.3307, GNorm = 0.2724, lr_0 = 9.8779e-04
Validation auc = 0.640680
Epoch 274
Validation auc = 0.632121
Epoch 275
Validation auc = 0.631249
Epoch 276
Validation auc = 0.634193
Epoch 277
Validation auc = 0.628796
Epoch 278
Loss = 3.3486e-02, PNorm = 93.4999, GNorm = 0.2195, lr_0 = 9.8756e-04
Validation auc = 0.623671
Epoch 279
Validation auc = 0.620400
Epoch 280
Validation auc = 0.617184
Epoch 281
Validation auc = 0.618110
Epoch 282
Validation auc = 0.629613
Epoch 283
Loss = 7.4265e-02, PNorm = 93.6568, GNorm = 0.6816, lr_0 = 9.8730e-04
Validation auc = 0.632339
Epoch 284
Validation auc = 0.635011
Epoch 285
Validation auc = 0.633430
Epoch 286
Validation auc = 0.629559
Epoch 287
Loss = 8.5860e-02, PNorm = 93.8063, GNorm = 0.3517, lr_0 = 9.8707e-04
Loss = 5.3042e-02, PNorm = 93.8240, GNorm = 0.8073, lr_0 = 9.8705e-04
Validation auc = 0.631140
Epoch 288
Validation auc = 0.627596
Epoch 289
Validation auc = 0.624325
Epoch 290
Validation auc = 0.626179
Epoch 291
Validation auc = 0.624980
Epoch 292
Loss = 2.8464e-02, PNorm = 94.0257, GNorm = 0.3768, lr_0 = 9.8683e-04
Validation auc = 0.624543
Epoch 293
Validation auc = 0.622308
Epoch 294
Validation auc = 0.617565
Epoch 295
Validation auc = 0.614621
Epoch 296
Validation auc = 0.617156
Epoch 297
Loss = 1.0980e-01, PNorm = 94.2170, GNorm = 1.1408, lr_0 = 9.8656e-04
Validation auc = 0.633075
Epoch 298
Validation auc = 0.632285
Epoch 299
Validation auc = 0.624652
Epoch 300
Validation auc = 0.624980
Epoch 301
Loss = 1.9237e-01, PNorm = 94.5005, GNorm = 1.1981, lr_0 = 9.8634e-04
Loss = 2.2524e-03, PNorm = 94.5192, GNorm = 0.1054, lr_0 = 9.8632e-04
Validation auc = 0.624598
Epoch 302
Validation auc = 0.624053
Epoch 303
Validation auc = 0.615058
Epoch 304
Validation auc = 0.615930
Epoch 305
Validation auc = 0.617620
Epoch 306
Loss = 1.5896e-01, PNorm = 94.8321, GNorm = 1.0076, lr_0 = 9.8607e-04
Loss = 3.4935e-02, PNorm = 94.8615, GNorm = 0.8707, lr_0 = 9.8606e-04
Validation auc = 0.632176
Epoch 307
Validation auc = 0.641880
Epoch 308
Validation auc = 0.646950
Epoch 309
Validation auc = 0.645205
Epoch 310
Validation auc = 0.646568
Epoch 311
Loss = 4.0785e-02, PNorm = 95.2035, GNorm = 0.3668, lr_0 = 9.8583e-04
Validation auc = 0.646841
Epoch 312
Validation auc = 0.642425
Epoch 313
Validation auc = 0.637900
Epoch 314
Validation auc = 0.634574
Epoch 315
Validation auc = 0.641553
Epoch 316
Loss = 8.3793e-02, PNorm = 95.5281, GNorm = 1.7930, lr_0 = 9.8557e-04
Validation auc = 0.642152
Epoch 317
Validation auc = 0.644169
Epoch 318
Validation auc = 0.641171
Epoch 319
Validation auc = 0.636864
Epoch 320
Loss = 2.0986e-02, PNorm = 95.6851, GNorm = 0.3872, lr_0 = 9.8534e-04
Loss = 3.6390e-02, PNorm = 95.6945, GNorm = 1.2908, lr_0 = 9.8532e-04
Validation auc = 0.631794
Epoch 321
Validation auc = 0.621709
Epoch 322
Validation auc = 0.615657
Epoch 323
Validation auc = 0.611405
Epoch 324
Validation auc = 0.608461
Epoch 325
Loss = 6.9917e-02, PNorm = 95.7957, GNorm = 0.4508, lr_0 = 9.8509e-04
Validation auc = 0.607371
Epoch 326
Validation auc = 0.608952
Epoch 327
Validation auc = 0.608843
Epoch 328
Validation auc = 0.629668
Epoch 329
Validation auc = 0.635937
Epoch 330
Loss = 3.1526e-02, PNorm = 95.8596, GNorm = 0.4953, lr_0 = 9.8483e-04
Validation auc = 0.636919
Epoch 331
Validation auc = 0.635011
Epoch 332
Validation auc = 0.631140
Epoch 333
Validation auc = 0.632121
Epoch 334
Loss = 1.0710e-02, PNorm = 95.9350, GNorm = 0.1362, lr_0 = 9.8461e-04
Loss = 8.1687e-02, PNorm = 95.9398, GNorm = 2.9591, lr_0 = 9.8459e-04
Validation auc = 0.639317
Epoch 335
Validation auc = 0.647768
Epoch 336
Validation auc = 0.650112
Epoch 337
Validation auc = 0.648204
Epoch 338
Validation auc = 0.647331
Epoch 339
Loss = 8.9611e-03, PNorm = 96.0529, GNorm = 0.2117, lr_0 = 9.8434e-04
Loss = 3.7368e-04, PNorm = 96.0601, GNorm = 0.0114, lr_0 = 9.8433e-04
Validation auc = 0.645859
Epoch 340
Validation auc = 0.645205
Epoch 341
Validation auc = 0.647277
Epoch 342
Validation auc = 0.648749
Epoch 343
Validation auc = 0.649349
Epoch 344
Loss = 8.1308e-03, PNorm = 96.1362, GNorm = 0.1538, lr_0 = 9.8410e-04
Validation auc = 0.652183
Epoch 345
Validation auc = 0.657908
Epoch 346
Validation auc = 0.658943
Epoch 347
Validation auc = 0.652565
Epoch 348
Validation auc = 0.649458
Epoch 349
Loss = 9.0111e-03, PNorm = 96.2540, GNorm = 0.2096, lr_0 = 9.8384e-04
Validation auc = 0.647768
Epoch 350
Validation auc = 0.647495
Epoch 351
Validation auc = 0.649349
Epoch 352
Validation auc = 0.655945
Epoch 353
Loss = 8.7032e-03, PNorm = 96.3565, GNorm = 0.3374, lr_0 = 9.8361e-04
Loss = 2.3392e-03, PNorm = 96.3698, GNorm = 0.0593, lr_0 = 9.8359e-04
Validation auc = 0.658453
Epoch 354
Validation auc = 0.662378
Epoch 355
Validation auc = 0.664450
Epoch 356
Validation auc = 0.667666
Epoch 357
Validation auc = 0.669029
Epoch 358
Loss = 4.9100e-03, PNorm = 96.5155, GNorm = 0.0866, lr_0 = 9.8335e-04
Validation auc = 0.669956
Epoch 359
Validation auc = 0.669193
Epoch 360
Validation auc = 0.667503
Epoch 361
Validation auc = 0.666194
Epoch 362
Validation auc = 0.665704
Epoch 363
Loss = 1.6266e-02, PNorm = 96.5999, GNorm = 0.6233, lr_0 = 9.8311e-04
Validation auc = 0.664014
Epoch 364
Validation auc = 0.658180
Epoch 365
Validation auc = 0.652510
Epoch 366
Validation auc = 0.645778
Epoch 367
Loss = 3.4404e-02, PNorm = 96.6580, GNorm = 0.2444, lr_0 = 9.8288e-04
Loss = 2.9297e-03, PNorm = 96.6644, GNorm = 0.0668, lr_0 = 9.8286e-04
Validation auc = 0.641335
Epoch 368
Validation auc = 0.636210
Epoch 369
Validation auc = 0.632367
Epoch 370
Validation auc = 0.629205
Epoch 371
Validation auc = 0.628987
Epoch 372
Loss = 3.6154e-03, PNorm = 96.7447, GNorm = 0.0175, lr_0 = 9.8262e-04
Loss = 1.6546e-03, PNorm = 96.7487, GNorm = 0.0460, lr_0 = 9.8260e-04
Validation auc = 0.628850
Epoch 373
Validation auc = 0.629123
Epoch 374
Validation auc = 0.629395
Epoch 375
Validation auc = 0.630159
Epoch 376
Validation auc = 0.626506
Epoch 377
Loss = 3.7552e-03, PNorm = 96.7914, GNorm = 0.0851, lr_0 = 9.8237e-04
Validation auc = 0.625552
Epoch 378
Validation auc = 0.624407
Epoch 379
Validation auc = 0.626915
Epoch 380
Validation auc = 0.630758
Epoch 381
Validation auc = 0.632721
Epoch 382
Loss = 2.6339e-03, PNorm = 96.8401, GNorm = 0.0527, lr_0 = 9.8211e-04
Validation auc = 0.635147
Epoch 383
Validation auc = 0.637709
Epoch 384
Validation auc = 0.638990
Epoch 385
Validation auc = 0.640299
Epoch 386
Loss = 1.9142e-03, PNorm = 96.8611, GNorm = 0.0613, lr_0 = 9.8189e-04
Loss = 2.1128e-04, PNorm = 96.8623, GNorm = 0.0061, lr_0 = 9.8187e-04
Validation auc = 0.640135
Epoch 387
Validation auc = 0.641062
Epoch 388
Validation auc = 0.639290
Epoch 389
Validation auc = 0.642534
Epoch 390
Validation auc = 0.652947
Epoch 391
Loss = 3.6538e-03, PNorm = 96.8907, GNorm = 0.1019, lr_0 = 9.8163e-04
Validation auc = 0.656763
Epoch 392
Validation auc = 0.655809
Epoch 393
Validation auc = 0.654310
Epoch 394
Validation auc = 0.653192
Epoch 395
Validation auc = 0.649621
Epoch 396
Loss = 3.2766e-03, PNorm = 96.9288, GNorm = 0.0784, lr_0 = 9.8138e-04
Validation auc = 0.654310
Epoch 397
Validation auc = 0.666794
Epoch 398
Validation auc = 0.668811
Epoch 399
Validation auc = 0.665104
Epoch 400
Loss = 4.5748e-02, PNorm = 97.1384, GNorm = 1.1419, lr_0 = 9.8116e-04
Loss = 4.2250e-02, PNorm = 97.1599, GNorm = 1.9799, lr_0 = 9.8114e-04
Validation auc = 0.665595
Epoch 401
Validation auc = 0.658235
Epoch 402
Validation auc = 0.648694
Epoch 403
Validation auc = 0.636210
Epoch 404
Validation auc = 0.629504
Epoch 405
Loss = 1.5582e-01, PNorm = 97.3812, GNorm = 0.9245, lr_0 = 9.8089e-04
Loss = 1.4888e-03, PNorm = 97.3913, GNorm = 0.0693, lr_0 = 9.8088e-04
Validation auc = 0.625743
Epoch 406
Validation auc = 0.622690
Epoch 407
Validation auc = 0.624980
Epoch 408
Validation auc = 0.626288
Epoch 409
Validation auc = 0.630622
Epoch 410
Loss = 1.1988e-02, PNorm = 97.5147, GNorm = 0.3228, lr_0 = 9.8065e-04
Validation auc = 0.631004
Epoch 411
Validation auc = 0.634656
Epoch 412
Validation auc = 0.635392
Epoch 413
Validation auc = 0.635283
Epoch 414
Validation auc = 0.633321
Epoch 415
Loss = 2.8847e-03, PNorm = 97.6008, GNorm = 0.0724, lr_0 = 9.8039e-04
Validation auc = 0.631004
Epoch 416
Validation auc = 0.629368
Epoch 417
Validation auc = 0.627460
Epoch 418
Validation auc = 0.625334
Epoch 419
Loss = 8.2783e-03, PNorm = 97.6344, GNorm = 0.4472, lr_0 = 9.8016e-04
Loss = 8.5098e-04, PNorm = 97.6364, GNorm = 0.0272, lr_0 = 9.8015e-04
Validation auc = 0.623671
Epoch 420
Validation auc = 0.622990
Epoch 421
Validation auc = 0.622935
Epoch 422
Validation auc = 0.623317
Epoch 423
Validation auc = 0.624734
Epoch 424
Loss = 8.8106e-02, PNorm = 97.6630, GNorm = 0.0993, lr_0 = 9.7990e-04
Validation auc = 0.623480
Epoch 425
Validation auc = 0.622853
Epoch 426
Validation auc = 0.626533
Epoch 427
Validation auc = 0.629314
Epoch 428
Validation auc = 0.637845
Epoch 429
Loss = 1.0469e-02, PNorm = 97.6844, GNorm = 0.3741, lr_0 = 9.7966e-04
Validation auc = 0.643052
Epoch 430
Validation auc = 0.645859
Epoch 431
Validation auc = 0.645887
Epoch 432
Validation auc = 0.647549
Epoch 433
Loss = 3.0513e-03, PNorm = 97.7191, GNorm = 0.0488, lr_0 = 9.7942e-04
Validation auc = 0.649321
Epoch 434
Validation auc = 0.650357
Epoch 435
Validation auc = 0.652292
Epoch 436
Validation auc = 0.654364
Epoch 437
Validation auc = 0.656517
Epoch 438
Loss = 3.3509e-03, PNorm = 97.7516, GNorm = 0.0406, lr_0 = 9.7917e-04
Loss = 5.1185e-04, PNorm = 97.7532, GNorm = 0.0164, lr_0 = 9.7916e-04
Validation auc = 0.657199
Epoch 439
Validation auc = 0.658289
Epoch 440
Validation auc = 0.659107
Epoch 441
Validation auc = 0.659843
Epoch 442
Validation auc = 0.659243
Epoch 443
Loss = 5.9598e-03, PNorm = 97.7727, GNorm = 0.0713, lr_0 = 9.7893e-04
Validation auc = 0.658589
Epoch 444
Validation auc = 0.657526
Epoch 445
Validation auc = 0.657526
Epoch 446
Validation auc = 0.656926
Epoch 447
Validation auc = 0.657090
Epoch 448
Loss = 2.6924e-03, PNorm = 97.8005, GNorm = 0.0579, lr_0 = 9.7867e-04
Validation auc = 0.657989
Epoch 449
Validation auc = 0.658916
Epoch 450
Validation auc = 0.660225
Epoch 451
Validation auc = 0.662405
Epoch 452
Loss = 3.2645e-03, PNorm = 97.8220, GNorm = 0.0910, lr_0 = 9.7845e-04
Loss = 1.2441e-03, PNorm = 97.8236, GNorm = 0.0421, lr_0 = 9.7843e-04
Validation auc = 0.663332
Epoch 453
Validation auc = 0.664313
Epoch 454
Validation auc = 0.664968
Epoch 455
Validation auc = 0.664531
Epoch 456
Validation auc = 0.663823
Epoch 457
Loss = 4.0311e-03, PNorm = 97.8427, GNorm = 0.0307, lr_0 = 9.7819e-04
Loss = 1.5598e-04, PNorm = 97.8440, GNorm = 0.0052, lr_0 = 9.7817e-04
Validation auc = 0.663605
Epoch 458
Validation auc = 0.663032
Epoch 459
Validation auc = 0.660688
Epoch 460
Validation auc = 0.659380
Epoch 461
Validation auc = 0.657853
Epoch 462
Loss = 2.9413e-03, PNorm = 97.8611, GNorm = 0.1529, lr_0 = 9.7794e-04
Validation auc = 0.656517
Epoch 463
Validation auc = 0.655100
Epoch 464
Validation auc = 0.653982
Epoch 465
Validation auc = 0.655209
Epoch 466
Loss = 1.6868e-03, PNorm = 97.8806, GNorm = 0.2688, lr_0 = 9.7770e-04
Validation auc = 0.657226
Epoch 467
Validation auc = 0.654119
Epoch 468
Validation auc = 0.657962
Epoch 469
Validation auc = 0.654173
Epoch 470
Validation auc = 0.648940
Epoch 471
Loss = 1.6020e-03, PNorm = 97.9289, GNorm = 0.0169, lr_0 = 9.7746e-04
Loss = 2.3725e-03, PNorm = 97.9336, GNorm = 0.1078, lr_0 = 9.7744e-04
Validation auc = 0.644060
Epoch 472
Validation auc = 0.647004
Epoch 473
Validation auc = 0.651720
Epoch 474
Validation auc = 0.656926
Epoch 475
Validation auc = 0.655291
Epoch 476
Loss = 4.2319e-03, PNorm = 98.0072, GNorm = 0.1150, lr_0 = 9.7721e-04
Validation auc = 0.652919
Epoch 477
Validation auc = 0.652592
Epoch 478
Validation auc = 0.652510
Epoch 479
Validation auc = 0.650711
Epoch 480
Validation auc = 0.647958
Epoch 481
Loss = 4.5009e-03, PNorm = 98.1327, GNorm = 0.0874, lr_0 = 9.7695e-04
Validation auc = 0.647986
Epoch 482
Validation auc = 0.648367
Epoch 483
Validation auc = 0.648912
Epoch 484
Validation auc = 0.648476
Epoch 485
Loss = 6.9302e-03, PNorm = 98.1980, GNorm = 0.3088, lr_0 = 9.7673e-04
Loss = 1.1412e-03, PNorm = 98.2020, GNorm = 0.0305, lr_0 = 9.7671e-04
Validation auc = 0.647113
Epoch 486
Validation auc = 0.645014
Epoch 487
Validation auc = 0.628659
Epoch 488
Validation auc = 0.639508
Epoch 489
Validation auc = 0.653764
Epoch 490
Loss = 8.8514e-02, PNorm = 98.4516, GNorm = 0.7855, lr_0 = 9.7647e-04
Loss = 8.8154e-03, PNorm = 98.4929, GNorm = 0.1725, lr_0 = 9.7645e-04
Validation auc = 0.663959
Epoch 491
Validation auc = 0.675517
Epoch 492
Validation auc = 0.677861
Epoch 493
Validation auc = 0.684185
Epoch 494
Validation auc = 0.692907
Epoch 495
Loss = 1.2247e-01, PNorm = 99.3630, GNorm = 1.7552, lr_0 = 9.7623e-04
Validation auc = 0.704519
Epoch 496
Validation auc = 0.734940
Epoch 497
Validation auc = 0.714496
Epoch 498
Validation auc = 0.698523
Epoch 499
Loss = 1.2937e-01, PNorm = 100.0788, GNorm = 1.0179, lr_0 = 9.7599e-04
Validation auc = 0.687074
Epoch 500
Validation auc = 0.674917
Epoch 501
Validation auc = 0.645532
Epoch 502
Validation auc = 0.617647
Epoch 503
Validation auc = 0.606008
Epoch 504
Loss = 5.6783e-02, PNorm = 100.8725, GNorm = 0.5092, lr_0 = 9.7574e-04
Loss = 4.2091e-02, PNorm = 100.9155, GNorm = 0.5785, lr_0 = 9.7573e-04
Validation auc = 0.600283
Epoch 505
Validation auc = 0.592678
Epoch 506
Validation auc = 0.598975
Epoch 507
Validation auc = 0.601974
Epoch 508
Validation auc = 0.605408
Epoch 509
Loss = 6.7372e-02, PNorm = 101.3443, GNorm = 0.5577, lr_0 = 9.7550e-04
Validation auc = 0.604917
Epoch 510
Validation auc = 0.609442
Epoch 511
Validation auc = 0.613913
Epoch 512
Validation auc = 0.616638
Epoch 513
Validation auc = 0.612086
Epoch 514
Loss = 1.3133e-02, PNorm = 101.6708, GNorm = 0.1782, lr_0 = 9.7524e-04
Validation auc = 0.612441
Epoch 515
Validation auc = 0.612195
Epoch 516
Validation auc = 0.612359
Epoch 517
Validation auc = 0.619201
Epoch 518
Loss = 6.2611e-02, PNorm = 101.8381, GNorm = 0.6534, lr_0 = 9.7502e-04
Loss = 1.3652e-02, PNorm = 101.8488, GNorm = 0.3337, lr_0 = 9.7500e-04
Validation auc = 0.634711
Epoch 519
Validation auc = 0.640517
Epoch 520
Validation auc = 0.646950
Epoch 521
Validation auc = 0.650548
Epoch 522
Validation auc = 0.652538
Epoch 523
Loss = 1.2592e-02, PNorm = 101.9952, GNorm = 0.5505, lr_0 = 9.7476e-04
Loss = 2.6596e-01, PNorm = 102.0087, GNorm = 5.7812, lr_0 = 9.7474e-04
Validation auc = 0.661097
Epoch 524
Validation auc = 0.672191
Epoch 525
Validation auc = 0.686474
Epoch 526
Validation auc = 0.704519
Epoch 527
Validation auc = 0.708172
Epoch 528
Loss = 3.9965e-02, PNorm = 102.2561, GNorm = 0.5472, lr_0 = 9.7452e-04
Validation auc = 0.706046
Epoch 529
Validation auc = 0.700758
Epoch 530
Validation auc = 0.695306
Epoch 531
Validation auc = 0.691926
Epoch 532
Validation auc = 0.690018
Epoch 533
Loss = 7.9676e-02, PNorm = 102.5210, GNorm = 1.0054, lr_0 = 9.7426e-04
Validation auc = 0.690999
Epoch 534
Validation auc = 0.681459
Epoch 535
Validation auc = 0.658562
Epoch 536
Validation auc = 0.642479
Epoch 537
Loss = 2.7005e-02, PNorm = 102.7175, GNorm = 0.4650, lr_0 = 9.7403e-04
Loss = 1.4230e-02, PNorm = 102.7335, GNorm = 0.2618, lr_0 = 9.7401e-04
Validation auc = 0.629177
Epoch 538
Validation auc = 0.625906
Epoch 539
Validation auc = 0.623780
Epoch 540
Validation auc = 0.624434
Epoch 541
Validation auc = 0.627106
Epoch 542
Loss = 1.4448e-02, PNorm = 102.9237, GNorm = 0.1699, lr_0 = 9.7379e-04
Validation auc = 0.630976
Epoch 543
Validation auc = 0.633321
Epoch 544
Validation auc = 0.637273
Epoch 545
Validation auc = 0.645832
Epoch 546
Validation auc = 0.650521
Epoch 547
Loss = 1.1733e-02, PNorm = 103.0534, GNorm = 0.2495, lr_0 = 9.7353e-04
Validation auc = 0.652074
Epoch 548
Validation auc = 0.646786
Epoch 549
Validation auc = 0.640789
Epoch 550
Validation auc = 0.636673
Epoch 551
Loss = 8.2099e-03, PNorm = 103.1307, GNorm = 0.1168, lr_0 = 9.7331e-04
Loss = 2.5361e-03, PNorm = 103.1361, GNorm = 0.1008, lr_0 = 9.7329e-04
Validation auc = 0.635229
Epoch 552
Validation auc = 0.635665
Epoch 553
Validation auc = 0.636619
Epoch 554
Validation auc = 0.640162
Epoch 555
Validation auc = 0.638881
Epoch 556
Loss = 4.2184e-02, PNorm = 103.2172, GNorm = 0.1575, lr_0 = 9.7305e-04
Loss = 2.1939e-03, PNorm = 103.2232, GNorm = 0.0828, lr_0 = 9.7303e-04
Validation auc = 0.644306
Epoch 557
Validation auc = 0.636673
Epoch 558
Validation auc = 0.632557
Epoch 559
Validation auc = 0.629068
Epoch 560
Validation auc = 0.630268
Epoch 561
Loss = 6.1133e-03, PNorm = 103.2860, GNorm = 0.1443, lr_0 = 9.7281e-04
Validation auc = 0.636864
Epoch 562
Validation auc = 0.644715
Epoch 563
Validation auc = 0.646405
Epoch 564
Validation auc = 0.637300
Epoch 565
Validation auc = 0.634193
Epoch 566
Loss = 2.3360e-02, PNorm = 103.4402, GNorm = 0.3685, lr_0 = 9.7255e-04
Validation auc = 0.628659
Epoch 567
Validation auc = 0.628360
Epoch 568
Validation auc = 0.645451
Epoch 569
Validation auc = 0.648585
Epoch 570
Loss = 1.7362e-02, PNorm = 103.6206, GNorm = 0.8795, lr_0 = 9.7232e-04
Loss = 1.1990e-02, PNorm = 103.6351, GNorm = 0.3125, lr_0 = 9.7231e-04
Validation auc = 0.652810
Epoch 571
Validation auc = 0.654446
Epoch 572
Validation auc = 0.653901
Epoch 573
Validation auc = 0.655727
Epoch 574
Validation auc = 0.664232
Epoch 575
Loss = 1.9073e-02, PNorm = 103.7576, GNorm = 0.3452, lr_0 = 9.7208e-04
Validation auc = 0.667148
Epoch 576
Validation auc = 0.663305
Epoch 577
Validation auc = 0.660606
Epoch 578
Validation auc = 0.652620
Epoch 579
Validation auc = 0.638227
Epoch 580
Loss = 2.0656e-01, PNorm = 103.8771, GNorm = 1.8652, lr_0 = 9.7182e-04
Validation auc = 0.638663
Epoch 581
Validation auc = 0.644415
Epoch 582
Validation auc = 0.649812
Epoch 583
Validation auc = 0.650412
Epoch 584
Loss = 5.9985e-02, PNorm = 104.1886, GNorm = 0.1997, lr_0 = 9.7160e-04
Loss = 2.9564e-02, PNorm = 104.2089, GNorm = 0.7631, lr_0 = 9.7158e-04
Validation auc = 0.643106
Epoch 585
Validation auc = 0.640980
Epoch 586
Validation auc = 0.645832
Epoch 587
Validation auc = 0.649049
Epoch 588
Validation auc = 0.650303
Epoch 589
Loss = 2.2911e-02, PNorm = 104.4813, GNorm = 1.4933, lr_0 = 9.7134e-04
Loss = 7.0523e-03, PNorm = 104.4947, GNorm = 0.1588, lr_0 = 9.7132e-04
Validation auc = 0.649130
Epoch 590
Validation auc = 0.647495
Epoch 591
Validation auc = 0.646323
Epoch 592
Validation auc = 0.645314
Epoch 593
Validation auc = 0.645805
Epoch 594
Loss = 1.0523e-02, PNorm = 104.6101, GNorm = 0.2426, lr_0 = 9.7110e-04
Validation auc = 0.644388
Epoch 595
Validation auc = 0.641934
Epoch 596
Validation auc = 0.640462
Epoch 597
Validation auc = 0.638554
Epoch 598
Validation auc = 0.638609
Epoch 599
Loss = 5.1620e-03, PNorm = 104.6731, GNorm = 0.1089, lr_0 = 9.7084e-04
Validation auc = 0.638554
Epoch 600
Validation auc = 0.639536
Epoch 601
Validation auc = 0.638718
Epoch 602
Validation auc = 0.637955
Epoch 603
Loss = 1.1317e-02, PNorm = 104.6960, GNorm = 0.3937, lr_0 = 9.7062e-04
Loss = 4.0184e-04, PNorm = 104.6976, GNorm = 0.0156, lr_0 = 9.7060e-04
Validation auc = 0.636483
Epoch 604
Validation auc = 0.638718
Epoch 605
Validation auc = 0.640571
Epoch 606
Validation auc = 0.640953
Epoch 607
Validation auc = 0.641662
Epoch 608
Loss = 2.8175e-03, PNorm = 104.7274, GNorm = 0.0260, lr_0 = 9.7036e-04
Validation auc = 0.641389
Epoch 609
Validation auc = 0.641498
Epoch 610
Validation auc = 0.641553
Epoch 611
Validation auc = 0.642261
Epoch 612
Validation auc = 0.644442
Epoch 613
Loss = 1.1892e-03, PNorm = 104.7612, GNorm = 0.0266, lr_0 = 9.7012e-04
Validation auc = 0.644606
Epoch 614
Validation auc = 0.650930
Epoch 615
Validation auc = 0.662214
Epoch 616
Validation auc = 0.664613
Epoch 617
Loss = 5.6844e-02, PNorm = 104.9666, GNorm = 0.0773, lr_0 = 9.6990e-04
Loss = 3.7477e-02, PNorm = 104.9937, GNorm = 1.5200, lr_0 = 9.6988e-04
Validation auc = 0.664450
Epoch 618
Validation auc = 0.658071
Epoch 619
Validation auc = 0.653982
Epoch 620
Validation auc = 0.647931
Epoch 621
Validation auc = 0.642861
Epoch 622
Loss = 5.9867e-02, PNorm = 105.3114, GNorm = 0.1146, lr_0 = 9.6964e-04
Loss = 1.8118e-02, PNorm = 105.3274, GNorm = 0.4189, lr_0 = 9.6962e-04
Validation auc = 0.639699
Epoch 623
Validation auc = 0.637137
Epoch 624
Validation auc = 0.623290
Epoch 625
Validation auc = 0.638718
Epoch 626
Validation auc = 0.652674
Epoch 627
Loss = 6.1094e-02, PNorm = 105.5451, GNorm = 0.7141, lr_0 = 9.6940e-04
Validation auc = 0.647549
Epoch 628
Validation auc = 0.641716
Epoch 629
Validation auc = 0.643624
Epoch 630
Validation auc = 0.645968
Epoch 631
Validation auc = 0.644796
Epoch 632
Loss = 3.7676e-02, PNorm = 105.7493, GNorm = 1.5196, lr_0 = 9.6914e-04
Validation auc = 0.632012
Epoch 633
Validation auc = 0.638064
Epoch 634
Validation auc = 0.639426
Epoch 635
Validation auc = 0.631685
Epoch 636
Loss = 1.4732e-02, PNorm = 105.8380, GNorm = 0.8645, lr_0 = 9.6892e-04
Loss = 3.2660e-04, PNorm = 105.8452, GNorm = 0.0207, lr_0 = 9.6890e-04
Validation auc = 0.635338
Epoch 637
Validation auc = 0.662978
Epoch 638
Validation auc = 0.687892
Epoch 639
Validation auc = 0.686093
Epoch 640
Validation auc = 0.679333
Epoch 641
Loss = 1.3522e-01, PNorm = 106.0124, GNorm = 0.8647, lr_0 = 9.6866e-04
Validation auc = 0.678842
Epoch 642
Validation auc = 0.676062
Epoch 643
Validation auc = 0.669847
Epoch 644
Validation auc = 0.670283
Epoch 645
Validation auc = 0.675626
Epoch 646
Loss = 6.3785e-02, PNorm = 106.1852, GNorm = 1.2979, lr_0 = 9.6842e-04
Validation auc = 0.679932
Epoch 647
Validation auc = 0.682113
Epoch 648
Validation auc = 0.681786
Epoch 649
Validation auc = 0.680150
Epoch 650
Loss = 1.3149e-02, PNorm = 106.2893, GNorm = 0.1381, lr_0 = 9.6820e-04
Loss = 1.7025e-03, PNorm = 106.2953, GNorm = 0.0720, lr_0 = 9.6818e-04
Validation auc = 0.680478
Epoch 651
Validation auc = 0.688982
Epoch 652
Validation auc = 0.689800
Epoch 653
Validation auc = 0.689582
Epoch 654
Validation auc = 0.688928
Epoch 655
Loss = 7.7416e-03, PNorm = 106.3879, GNorm = 0.1620, lr_0 = 9.6794e-04
Loss = 1.3621e-03, PNorm = 106.3933, GNorm = 0.0781, lr_0 = 9.6792e-04
Validation auc = 0.687728
Epoch 656
Validation auc = 0.685847
Epoch 657
Validation auc = 0.685493
Epoch 658
Validation auc = 0.683094
Epoch 659
Validation auc = 0.678515
Epoch 660
Loss = 1.4731e-02, PNorm = 106.4420, GNorm = 0.5336, lr_0 = 9.6770e-04
Validation auc = 0.674208
Epoch 661
Validation auc = 0.673390
Epoch 662
Validation auc = 0.671809
Epoch 663
Validation auc = 0.671046
Epoch 664
Validation auc = 0.671428
Epoch 665
Loss = 1.7913e-02, PNorm = 106.4879, GNorm = 0.6691, lr_0 = 9.6744e-04
Validation auc = 0.670392
Epoch 666
Validation auc = 0.669901
Epoch 667
Validation auc = 0.669220
Epoch 668
Validation auc = 0.667148
Epoch 669
Loss = 2.3881e-03, PNorm = 106.5229, GNorm = 0.0824, lr_0 = 9.6722e-04
Loss = 7.6597e-04, PNorm = 106.5251, GNorm = 0.0479, lr_0 = 9.6720e-04
Validation auc = 0.664613
Epoch 670
Validation auc = 0.662814
Epoch 671
Validation auc = 0.662324
Epoch 672
Validation auc = 0.661642
Epoch 673
Validation auc = 0.660933
Epoch 674
Loss = 1.2197e-03, PNorm = 106.5484, GNorm = 0.0095, lr_0 = 9.6696e-04
Validation auc = 0.660116
Epoch 675
Validation auc = 0.660852
Epoch 676
Validation auc = 0.660252
Epoch 677
Validation auc = 0.660034
Epoch 678
Validation auc = 0.661669
Epoch 679
Loss = 4.5658e-04, PNorm = 106.5609, GNorm = 0.0079, lr_0 = 9.6672e-04
Validation auc = 0.661369
Epoch 680
Validation auc = 0.662324
Epoch 681
Validation auc = 0.662187
Epoch 682
Validation auc = 0.662869
Epoch 683
Loss = 4.1434e-02, PNorm = 106.5745, GNorm = 0.0198, lr_0 = 9.6648e-04
Validation auc = 0.663468
Epoch 684
Validation auc = 0.663795
Epoch 685
Validation auc = 0.660633
Epoch 686
Validation auc = 0.661124
Epoch 687
Validation auc = 0.662433
Epoch 688
Loss = 4.0762e-03, PNorm = 106.5970, GNorm = 0.0677, lr_0 = 9.6624e-04
Loss = 4.7531e-04, PNorm = 106.5995, GNorm = 0.0203, lr_0 = 9.6622e-04
Validation auc = 0.661996
Epoch 689
Validation auc = 0.659925
Epoch 690
Validation auc = 0.659271
Epoch 691
Validation auc = 0.655672
Epoch 692
Validation auc = 0.654909
Epoch 693
Loss = 2.2552e-03, PNorm = 106.6244, GNorm = 0.0583, lr_0 = 9.6600e-04
Validation auc = 0.653383
Epoch 694
Validation auc = 0.646459
Epoch 695
Validation auc = 0.651529
Epoch 696
Validation auc = 0.652238
Epoch 697
Validation auc = 0.656272
Epoch 698
Loss = 1.3707e-03, PNorm = 106.6307, GNorm = 0.0268, lr_0 = 9.6574e-04
Validation auc = 0.660306
Epoch 699
Validation auc = 0.662542
Epoch 700
Validation auc = 0.662324
Epoch 701
Validation auc = 0.660415
Epoch 702
Loss = 3.6833e-03, PNorm = 106.6553, GNorm = 0.0719, lr_0 = 9.6552e-04
Loss = 2.5565e-04, PNorm = 106.6573, GNorm = 0.0170, lr_0 = 9.6550e-04
Validation auc = 0.659925
Epoch 703
Validation auc = 0.658235
Epoch 704
Validation auc = 0.656436
Epoch 705
Validation auc = 0.655400
Epoch 706
Validation auc = 0.654419
Epoch 707
Loss = 2.5623e-02, PNorm = 106.6782, GNorm = 1.2652, lr_0 = 9.6526e-04
Loss = 7.4135e-04, PNorm = 106.6801, GNorm = 0.0233, lr_0 = 9.6525e-04
Validation auc = 0.652947
Epoch 708
Validation auc = 0.650766
Epoch 709
Validation auc = 0.648204
Epoch 710
Validation auc = 0.645205
Epoch 711
Validation auc = 0.655127
Epoch 712
Loss = 4.8540e-02, PNorm = 106.7233, GNorm = 1.2481, lr_0 = 9.6502e-04
Validation auc = 0.655482
Epoch 713
Validation auc = 0.651829
Epoch 714
Validation auc = 0.651775
Epoch 715
Validation auc = 0.653246
Epoch 716
Loss = 2.1451e-03, PNorm = 106.7709, GNorm = 0.0046, lr_0 = 9.6479e-04
Validation auc = 0.654691
Epoch 717
Validation auc = 0.655318
Epoch 718
Validation auc = 0.655918
Epoch 719
Validation auc = 0.660524
Epoch 720
Validation auc = 0.663768
Epoch 721
Loss = 1.6117e-03, PNorm = 106.8136, GNorm = 0.0884, lr_0 = 9.6455e-04
Loss = 4.2114e-04, PNorm = 106.8164, GNorm = 0.0132, lr_0 = 9.6453e-04
Validation auc = 0.664668
Epoch 722
Validation auc = 0.661097
Epoch 723
Validation auc = 0.657117
Epoch 724
Validation auc = 0.654991
Epoch 725
Validation auc = 0.652074
Epoch 726
Loss = 1.5754e-03, PNorm = 106.8399, GNorm = 0.0584, lr_0 = 9.6431e-04
Validation auc = 0.650003
Epoch 727
Validation auc = 0.648994
Epoch 728
Validation auc = 0.647904
Epoch 729
Validation auc = 0.648367
Epoch 730
Validation auc = 0.649512
Epoch 731
Loss = 1.3543e-03, PNorm = 106.8472, GNorm = 0.0304, lr_0 = 9.6405e-04
Validation auc = 0.648994
Epoch 732
Validation auc = 0.652238
Epoch 733
Validation auc = 0.652538
Epoch 734
Validation auc = 0.633212
Epoch 735
Loss = 5.7504e-02, PNorm = 107.0022, GNorm = 1.3722, lr_0 = 9.6383e-04
Loss = 2.7126e-03, PNorm = 107.0333, GNorm = 0.0929, lr_0 = 9.6381e-04
Validation auc = 0.622744
Epoch 736
Validation auc = 0.619146
Epoch 737
Validation auc = 0.617347
Epoch 738
Validation auc = 0.630568
Epoch 739
Validation auc = 0.638363
Epoch 740
Loss = 1.1467e-02, PNorm = 107.4783, GNorm = 0.2047, lr_0 = 9.6357e-04
Loss = 2.1046e-01, PNorm = 107.5248, GNorm = 10.4343, lr_0 = 9.6355e-04
Validation auc = 0.640081
Epoch 741
Validation auc = 0.654419
Epoch 742
Validation auc = 0.656599
Epoch 743
Validation auc = 0.659052
Epoch 744
Validation auc = 0.655509
Epoch 745
Loss = 9.8272e-02, PNorm = 108.2514, GNorm = 1.1587, lr_0 = 9.6333e-04
Validation auc = 0.666630
Epoch 746
Validation auc = 0.672382
Epoch 747
Validation auc = 0.656081
Epoch 748
Validation auc = 0.648204
Epoch 749
Loss = 5.3581e-02, PNorm = 108.8877, GNorm = 0.2740, lr_0 = 9.6309e-04
Validation auc = 0.643379
Epoch 750
Validation auc = 0.644987
Epoch 751
Validation auc = 0.646132
Epoch 752
Validation auc = 0.663959
Epoch 753
Validation auc = 0.669956
Epoch 754
Loss = 9.1049e-02, PNorm = 109.2667, GNorm = 1.0006, lr_0 = 9.6285e-04
Loss = 1.0419e-02, PNorm = 109.2956, GNorm = 0.5196, lr_0 = 9.6284e-04
Validation auc = 0.659570
Epoch 755
Validation auc = 0.639754
Epoch 756
Validation auc = 0.633484
Epoch 757
Validation auc = 0.626997
Epoch 758
Validation auc = 0.624707
Epoch 759
Loss = 1.0165e-02, PNorm = 109.6049, GNorm = 0.1230, lr_0 = 9.6262e-04
Validation auc = 0.626452
Epoch 760
Validation auc = 0.633266
Epoch 761
Validation auc = 0.642098
Epoch 762
Validation auc = 0.650275
Epoch 763
Validation auc = 0.669901
Epoch 764
Loss = 6.5626e-03, PNorm = 109.8193, GNorm = 0.2116, lr_0 = 9.6236e-04
Validation auc = 0.679987
Epoch 765
Validation auc = 0.675898
Epoch 766
Validation auc = 0.667230
Epoch 767
Validation auc = 0.662487
Epoch 768
Loss = 1.0150e-01, PNorm = 110.0133, GNorm = 1.4652, lr_0 = 9.6214e-04
Loss = 8.1523e-04, PNorm = 110.0359, GNorm = 0.0244, lr_0 = 9.6212e-04
Validation auc = 0.670719
Epoch 769
Validation auc = 0.664940
Epoch 770
Validation auc = 0.657799
Epoch 771
Validation auc = 0.652129
Epoch 772
Validation auc = 0.653383
Epoch 773
Loss = 3.4875e-02, PNorm = 110.3404, GNorm = 0.8506, lr_0 = 9.6188e-04
Loss = 6.6257e-02, PNorm = 110.3596, GNorm = 1.3514, lr_0 = 9.6186e-04
Validation auc = 0.647659
Epoch 774
Validation auc = 0.643297
Epoch 775
Validation auc = 0.640135
Epoch 776
Validation auc = 0.634629
Epoch 777
Validation auc = 0.628741
Epoch 778
Loss = 1.6328e-02, PNorm = 110.5443, GNorm = 0.1762, lr_0 = 9.6164e-04
Validation auc = 0.625034
Epoch 779
Validation auc = 0.622036
Epoch 780
Validation auc = 0.617347
Epoch 781
Validation auc = 0.626397
Epoch 782
Validation auc = 0.640571
Epoch 783
Loss = 5.6887e-03, PNorm = 110.6676, GNorm = 0.1622, lr_0 = 9.6139e-04
Validation auc = 0.649948
Epoch 784
Validation auc = 0.653328
Epoch 785
Validation auc = 0.654909
Epoch 786
Validation auc = 0.656218
Epoch 787
Loss = 7.2579e-03, PNorm = 110.7323, GNorm = 0.1562, lr_0 = 9.6117e-04
Loss = 1.4432e-04, PNorm = 110.7356, GNorm = 0.0040, lr_0 = 9.6115e-04
Validation auc = 0.658071
Epoch 788
Validation auc = 0.661397
Epoch 789
Validation auc = 0.665431
Epoch 790
Validation auc = 0.670501
Epoch 791
Validation auc = 0.668866
Epoch 792
Loss = 6.9345e-03, PNorm = 110.7773, GNorm = 0.1493, lr_0 = 9.6093e-04
Validation auc = 0.664886
Epoch 793
Validation auc = 0.660470
Epoch 794
Validation auc = 0.658180
Epoch 795
Validation auc = 0.659107
Epoch 796
Validation auc = 0.664068
Epoch 797
Loss = 4.8015e-03, PNorm = 110.8267, GNorm = 0.0897, lr_0 = 9.6067e-04
Validation auc = 0.667557
Epoch 798
Validation auc = 0.673281
Epoch 799
Validation auc = 0.676770
Epoch 800
Validation auc = 0.678351
Epoch 801
Loss = 5.1401e-03, PNorm = 110.9179, GNorm = 0.0863, lr_0 = 9.6045e-04
Loss = 1.9290e-04, PNorm = 110.9236, GNorm = 0.0077, lr_0 = 9.6043e-04
Validation auc = 0.678297
Epoch 802
Validation auc = 0.680096
Epoch 803
Validation auc = 0.682059
Epoch 804
Validation auc = 0.684566
Epoch 805
Validation auc = 0.684784
Epoch 806
Loss = 6.6944e-03, PNorm = 110.9819, GNorm = 0.1035, lr_0 = 9.6019e-04
Loss = 3.1812e-02, PNorm = 110.9860, GNorm = 0.9664, lr_0 = 9.6018e-04
Validation auc = 0.684239
Epoch 807
Validation auc = 0.682713
Epoch 808
Validation auc = 0.680096
Epoch 809
Validation auc = 0.678351
Epoch 810
Validation auc = 0.676062
Epoch 811
Loss = 1.4278e-03, PNorm = 111.0337, GNorm = 0.0320, lr_0 = 9.5996e-04
Validation auc = 0.673827
Epoch 812
Validation auc = 0.673554
Epoch 813
Validation auc = 0.673608
Epoch 814
Validation auc = 0.673445
Epoch 815
Validation auc = 0.673336
Epoch 816
Loss = 5.9065e-04, PNorm = 111.0719, GNorm = 0.0108, lr_0 = 9.5970e-04
Validation auc = 0.673390
Epoch 817
Validation auc = 0.672082
Epoch 818
Validation auc = 0.671809
Epoch 819
Validation auc = 0.672954
Epoch 820
Loss = 6.0379e-03, PNorm = 111.0962, GNorm = 0.2002, lr_0 = 9.5948e-04
Loss = 1.0336e-03, PNorm = 111.0987, GNorm = 0.0410, lr_0 = 9.5946e-04
Validation auc = 0.674753
Epoch 821
Validation auc = 0.675626
Epoch 822
Validation auc = 0.670828
Epoch 823
Validation auc = 0.667448
Epoch 824
Validation auc = 0.664559
Epoch 825
Loss = 1.8665e-03, PNorm = 111.1209, GNorm = 0.0401, lr_0 = 9.5924e-04
Validation auc = 0.662542
Epoch 826
Validation auc = 0.661615
Epoch 827
Validation auc = 0.647549
Epoch 828
Validation auc = 0.634193
Epoch 829
Validation auc = 0.627814
Epoch 830
Loss = 2.5973e-03, PNorm = 111.1544, GNorm = 0.1116, lr_0 = 9.5899e-04
Validation auc = 0.629832
Epoch 831
Validation auc = 0.632884
Epoch 832
Validation auc = 0.636646
Epoch 833
Validation auc = 0.638827
Epoch 834
Loss = 1.4423e-03, PNorm = 111.1871, GNorm = 0.0297, lr_0 = 9.5877e-04
Loss = 2.4600e-04, PNorm = 111.1892, GNorm = 0.0113, lr_0 = 9.5875e-04
Validation auc = 0.641062
Epoch 835
Validation auc = 0.643842
Epoch 836
Validation auc = 0.643461
Epoch 837
Validation auc = 0.642261
Epoch 838
Validation auc = 0.640135
Epoch 839
Loss = 7.3368e-04, PNorm = 111.2219, GNorm = 0.0132, lr_0 = 9.5851e-04
Loss = 2.1028e-02, PNorm = 111.2251, GNorm = 0.9067, lr_0 = 9.5849e-04
Validation auc = 0.638827
Epoch 840
Validation auc = 0.636701
Epoch 841
Validation auc = 0.636101
Epoch 842
Validation auc = 0.635828
Epoch 843
Validation auc = 0.638391
Epoch 844
Loss = 1.7661e-03, PNorm = 111.2633, GNorm = 0.0652, lr_0 = 9.5827e-04
Validation auc = 0.645968
Epoch 845
Validation auc = 0.652347
Epoch 846
Validation auc = 0.650439
Epoch 847
Validation auc = 0.651366
Epoch 848
Validation auc = 0.648640
Epoch 849
Loss = 3.6358e-03, PNorm = 111.3096, GNorm = 0.0683, lr_0 = 9.5802e-04
Validation auc = 0.645532
Epoch 850
Validation auc = 0.644606
Epoch 851
Validation auc = 0.646841
Epoch 852
Validation auc = 0.650548
Epoch 853
Loss = 1.0833e-02, PNorm = 111.3630, GNorm = 0.2916, lr_0 = 9.5780e-04
Loss = 1.3741e-03, PNorm = 111.3698, GNorm = 0.0535, lr_0 = 9.5778e-04
Validation auc = 0.652401
Epoch 854
Validation auc = 0.652401
Epoch 855
Validation auc = 0.649158
Epoch 856
Validation auc = 0.647386
Epoch 857
Validation auc = 0.646650
Epoch 858
Loss = 2.3443e-03, PNorm = 111.4415, GNorm = 0.0407, lr_0 = 9.5754e-04
Validation auc = 0.645996
Epoch 859
Validation auc = 0.644796
Epoch 860
Validation auc = 0.644388
Epoch 861
Validation auc = 0.644306
Epoch 862
Validation auc = 0.644687
Epoch 863
Loss = 5.5014e-04, PNorm = 111.4777, GNorm = 0.0103, lr_0 = 9.5730e-04
Validation auc = 0.644360
Epoch 864
Validation auc = 0.644415
Epoch 865
Validation auc = 0.643761
Epoch 866
Validation auc = 0.643897
Epoch 867
Loss = 1.9764e-02, PNorm = 111.5042, GNorm = 0.0112, lr_0 = 9.5708e-04
Loss = 3.2782e-06, PNorm = 111.5066, GNorm = 0.0001, lr_0 = 9.5707e-04
Validation auc = 0.642888
Epoch 868
Validation auc = 0.642943
Epoch 869
Validation auc = 0.641962
Epoch 870
Validation auc = 0.640271
Epoch 871
Validation auc = 0.637437
Epoch 872
Loss = 4.4933e-02, PNorm = 111.5417, GNorm = 0.0434, lr_0 = 9.5683e-04
Loss = 5.9017e-04, PNorm = 111.5446, GNorm = 0.0121, lr_0 = 9.5681e-04
Validation auc = 0.637682
Epoch 873
Validation auc = 0.636374
Epoch 874
Validation auc = 0.634220
Epoch 875
Validation auc = 0.630513
Epoch 876
Validation auc = 0.628060
Epoch 877
Loss = 1.1808e-02, PNorm = 111.5647, GNorm = 0.3946, lr_0 = 9.5659e-04
Validation auc = 0.628196
Epoch 878
Validation auc = 0.629150
Epoch 879
Validation auc = 0.632775
Epoch 880
Validation auc = 0.633702
Epoch 881
Validation auc = 0.635065
Epoch 882
Loss = 4.6280e-03, PNorm = 111.6111, GNorm = 0.1172, lr_0 = 9.5634e-04
Validation auc = 0.637791
Epoch 883
Validation auc = 0.637791
Epoch 884
Validation auc = 0.632012
Epoch 885
Validation auc = 0.628687
Epoch 886
Loss = 1.1736e-01, PNorm = 111.9448, GNorm = 0.5955, lr_0 = 9.5612e-04
Loss = 5.0149e-03, PNorm = 111.9656, GNorm = 0.0929, lr_0 = 9.5610e-04
Validation auc = 0.632994
Epoch 887
Validation auc = 0.638609
Epoch 888
Validation auc = 0.647659
Epoch 889
Validation auc = 0.656272
Epoch 890
Validation auc = 0.664886
Epoch 891
Loss = 1.9597e-02, PNorm = 112.1614, GNorm = 0.4912, lr_0 = 9.5586e-04
Validation auc = 0.672627
Epoch 892
Validation auc = 0.674590
Epoch 893
Validation auc = 0.673336
Epoch 894
Validation auc = 0.672518
Epoch 895
Validation auc = 0.670828
Epoch 896
Loss = 1.7531e-03, PNorm = 112.2659, GNorm = 0.0376, lr_0 = 9.5563e-04
Validation auc = 0.670392
Epoch 897
Validation auc = 0.667830
Epoch 898
Validation auc = 0.666957
Epoch 899
Validation auc = 0.669084
Epoch 900
Loss = 1.1662e-01, PNorm = 112.3412, GNorm = 2.1882, lr_0 = 9.5541e-04
Loss = 1.0609e-02, PNorm = 112.3554, GNorm = 0.2232, lr_0 = 9.5539e-04
Validation auc = 0.679006
Epoch 901
Validation auc = 0.683967
Epoch 902
Validation auc = 0.679224
Epoch 903
Validation auc = 0.674317
Epoch 904
Validation auc = 0.670610
Epoch 905
Loss = 1.9949e-02, PNorm = 112.5337, GNorm = 0.2022, lr_0 = 9.5515e-04
Loss = 1.5761e-02, PNorm = 112.5430, GNorm = 0.3528, lr_0 = 9.5513e-04
Validation auc = 0.669247
Epoch 906
Validation auc = 0.673118
Epoch 907
Validation auc = 0.672682
Epoch 908
Validation auc = 0.672736
Epoch 909
Validation auc = 0.669247
Epoch 910
Loss = 6.6765e-03, PNorm = 112.6528, GNorm = 0.1056, lr_0 = 9.5491e-04
Validation auc = 0.667230
Epoch 911
Validation auc = 0.665595
Epoch 912
Validation auc = 0.668811
Epoch 913
Validation auc = 0.671101
Epoch 914
Validation auc = 0.669029
Epoch 915
Loss = 1.6986e-02, PNorm = 112.7462, GNorm = 0.3877, lr_0 = 9.5466e-04
Validation auc = 0.663305
Epoch 916
Validation auc = 0.659162
Epoch 917
Validation auc = 0.655836
Epoch 918
Validation auc = 0.670719
Epoch 919
Loss = 1.0237e-02, PNorm = 112.8872, GNorm = 0.3318, lr_0 = 9.5444e-04
Loss = 3.1717e-03, PNorm = 112.8972, GNorm = 0.1478, lr_0 = 9.5442e-04
Validation auc = 0.679605
Epoch 920
Validation auc = 0.677806
Epoch 921
Validation auc = 0.669411
Epoch 922
Validation auc = 0.663741
Epoch 923
Validation auc = 0.660197
Epoch 924
Loss = 3.5878e-03, PNorm = 113.0199, GNorm = 0.0786, lr_0 = 9.5419e-04
Validation auc = 0.656763
Epoch 925
Validation auc = 0.654091
Epoch 926
Validation auc = 0.645805
Epoch 927
Validation auc = 0.639863
Epoch 928
Validation auc = 0.633757
Epoch 929
Loss = 5.2054e-02, PNorm = 113.1006, GNorm = 0.7054, lr_0 = 9.5395e-04
Validation auc = 0.634438
Epoch 930
Validation auc = 0.635610
Epoch 931
Validation auc = 0.634929
Epoch 932
Validation auc = 0.634738
Epoch 933
Loss = 1.8913e-02, PNorm = 113.1930, GNorm = 1.3110, lr_0 = 9.5371e-04
Validation auc = 0.634384
Epoch 934
Validation auc = 0.633430
Epoch 935
Validation auc = 0.631631
Epoch 936
Validation auc = 0.638718
Epoch 937
Validation auc = 0.647059
Epoch 938
Loss = 1.4868e-02, PNorm = 113.3488, GNorm = 0.1832, lr_0 = 9.5348e-04
Loss = 2.8258e-03, PNorm = 113.3582, GNorm = 0.0702, lr_0 = 9.5346e-04
Validation auc = 0.656872
Epoch 939
Validation auc = 0.659107
Epoch 940
Validation auc = 0.659162
Epoch 941
Validation auc = 0.658889
Epoch 942
Validation auc = 0.660415
Epoch 943
Loss = 8.9157e-03, PNorm = 113.4383, GNorm = 0.2139, lr_0 = 9.5324e-04
Validation auc = 0.663087
Epoch 944
Validation auc = 0.665976
Epoch 945
Validation auc = 0.667339
Epoch 946
Validation auc = 0.668811
Epoch 947
Validation auc = 0.671319
Epoch 948
Loss = 1.0032e-03, PNorm = 113.4791, GNorm = 0.0147, lr_0 = 9.5299e-04
Validation auc = 0.673172
Epoch 949
Validation auc = 0.676661
Epoch 950
Validation auc = 0.678569
Epoch 951
Validation auc = 0.677915
Epoch 952
Loss = 3.0243e-03, PNorm = 113.5076, GNorm = 0.0550, lr_0 = 9.5277e-04
Loss = 1.2211e-03, PNorm = 113.5100, GNorm = 0.0465, lr_0 = 9.5275e-04
Validation auc = 0.675298
Epoch 953
Validation auc = 0.673336
Epoch 954
Validation auc = 0.672845
Epoch 955
Validation auc = 0.672518
Epoch 956
Validation auc = 0.673118
Epoch 957
Loss = 5.8592e-02, PNorm = 113.5346, GNorm = 0.0094, lr_0 = 9.5251e-04
Loss = 7.5609e-03, PNorm = 113.5352, GNorm = 0.3016, lr_0 = 9.5250e-04
Validation auc = 0.674099
Epoch 958
Validation auc = 0.675298
Epoch 959
Validation auc = 0.675735
Epoch 960
Validation auc = 0.677370
Epoch 961
Validation auc = 0.677697
Epoch 962
Loss = 2.3328e-03, PNorm = 113.5531, GNorm = 0.0350, lr_0 = 9.5228e-04
Validation auc = 0.677643
Epoch 963
Validation auc = 0.676443
Epoch 964
Validation auc = 0.676143
Epoch 965
Validation auc = 0.675653
Epoch 966
Loss = 2.8074e-03, PNorm = 113.5729, GNorm = 0.0106, lr_0 = 9.5204e-04
Validation auc = 0.674126
Epoch 967
Validation auc = 0.674699
Epoch 968
Validation auc = 0.675380
Epoch 969
Validation auc = 0.674835
Epoch 970
Validation auc = 0.674672
Epoch 971
Loss = 3.3395e-02, PNorm = 113.5930, GNorm = 0.5081, lr_0 = 9.5180e-04
Loss = 5.7552e-05, PNorm = 113.5936, GNorm = 0.0024, lr_0 = 9.5179e-04
Validation auc = 0.674508
Epoch 972
Validation auc = 0.657008
Epoch 973
Validation auc = 0.639590
Epoch 974
Validation auc = 0.634411
Epoch 975
Validation auc = 0.632721
Epoch 976
Loss = 4.6712e-03, PNorm = 113.6310, GNorm = 0.0831, lr_0 = 9.5157e-04
Validation auc = 0.632394
Epoch 977
Validation auc = 0.632775
Epoch 978
Validation auc = 0.631522
Epoch 979
Validation auc = 0.631194
Epoch 980
Validation auc = 0.630867
Epoch 981
Loss = 4.9029e-04, PNorm = 113.6806, GNorm = 0.0082, lr_0 = 9.5132e-04
Validation auc = 0.630486
Epoch 982
Validation auc = 0.629941
Epoch 983
Validation auc = 0.629286
Epoch 984
Validation auc = 0.629341
Epoch 985
Loss = 8.2968e-04, PNorm = 113.6991, GNorm = 0.0105, lr_0 = 9.5110e-04
Loss = 1.5775e+00, PNorm = 113.6968, GNorm = 6.7476, lr_0 = 9.5108e-04
Validation auc = 0.633975
Epoch 986
Validation auc = 0.642534
Epoch 987
Validation auc = 0.638772
Epoch 988
Validation auc = 0.627869
Epoch 989
Validation auc = 0.618492
Epoch 990
Loss = 1.7296e-02, PNorm = 113.9243, GNorm = 0.1997, lr_0 = 9.5084e-04
Loss = 2.6760e-02, PNorm = 113.9431, GNorm = 1.5430, lr_0 = 9.5083e-04
Validation auc = 0.618601
Epoch 991
Validation auc = 0.630704
Epoch 992
Validation auc = 0.640026
Epoch 993
Validation auc = 0.643243
Epoch 994
Validation auc = 0.645696
Epoch 995
Loss = 3.5026e-02, PNorm = 114.2576, GNorm = 0.4087, lr_0 = 9.5061e-04
Validation auc = 0.639426
Epoch 996
Validation auc = 0.653928
Epoch 997
Validation auc = 0.653710
Epoch 998
Validation auc = 0.650493
Epoch 999
Loss = 5.9776e-02, PNorm = 114.7227, GNorm = 0.1728, lr_0 = 9.5037e-04
Validation auc = 0.642916
Epoch 1000
Validation auc = 0.639645
Epoch 1001
Validation auc = 0.635719
Epoch 1002
Validation auc = 0.632039
Epoch 1003
Validation auc = 0.633021
Epoch 1004
Loss = 2.7184e-02, PNorm = 115.0623, GNorm = 0.7183, lr_0 = 9.5014e-04
Loss = 8.2601e-03, PNorm = 115.0793, GNorm = 0.2020, lr_0 = 9.5012e-04
Validation auc = 0.635556
Epoch 1005
Validation auc = 0.657581
Epoch 1006
Validation auc = 0.667394
Epoch 1007
Validation auc = 0.683967
Epoch 1008
Validation auc = 0.677915
Epoch 1009
Loss = 6.5512e-02, PNorm = 115.6101, GNorm = 0.8985, lr_0 = 9.4990e-04
Validation auc = 0.670610
Epoch 1010
Validation auc = 0.664395
Epoch 1011
Validation auc = 0.659598
Epoch 1012
Validation auc = 0.651965
Epoch 1013
Validation auc = 0.643842
Epoch 1014
Loss = 4.3045e-02, PNorm = 116.2987, GNorm = 0.5284, lr_0 = 9.4965e-04
Validation auc = 0.627378
Epoch 1015
Validation auc = 0.611241
Epoch 1016
Validation auc = 0.582402
Epoch 1017
Validation auc = 0.611241
Epoch 1018
Loss = 7.1611e-02, PNorm = 116.6627, GNorm = 1.4126, lr_0 = 9.4943e-04
Loss = 1.0657e-01, PNorm = 116.6860, GNorm = 2.6329, lr_0 = 9.4941e-04
Validation auc = 0.643079
Epoch 1019
Validation auc = 0.654664
Epoch 1020
Validation auc = 0.646732
Epoch 1021
Validation auc = 0.637082
Epoch 1022
Validation auc = 0.631140
Epoch 1023
Loss = 3.8314e-02, PNorm = 116.9705, GNorm = 1.1692, lr_0 = 9.4918e-04
Loss = 1.6416e-02, PNorm = 116.9876, GNorm = 0.8423, lr_0 = 9.4916e-04
Validation auc = 0.627978
Epoch 1024
Validation auc = 0.626015
Epoch 1025
Validation auc = 0.624816
Epoch 1026
Validation auc = 0.626670
Epoch 1027
Validation auc = 0.656054
Epoch 1028
Loss = 5.3648e-03, PNorm = 117.2187, GNorm = 0.1046, lr_0 = 9.4894e-04
Validation auc = 0.684294
Epoch 1029
Validation auc = 0.626888
Epoch 1030
Validation auc = 0.623998
Epoch 1031
Validation auc = 0.618001
Epoch 1032
Validation auc = 0.614730
Epoch 1033
Loss = 1.9955e-02, PNorm = 117.4128, GNorm = 0.3680, lr_0 = 9.4869e-04
Validation auc = 0.615548
Epoch 1034
Validation auc = 0.623071
Epoch 1035
Validation auc = 0.628360
Epoch 1036
Validation auc = 0.631140
Epoch 1037
Loss = 4.8774e-02, PNorm = 117.5629, GNorm = 1.6341, lr_0 = 9.4847e-04
Loss = 3.1296e-03, PNorm = 117.5718, GNorm = 0.1285, lr_0 = 9.4845e-04
Validation auc = 0.634465
Epoch 1038
Validation auc = 0.641771
Epoch 1039
Validation auc = 0.642861
Epoch 1040
Validation auc = 0.639972
Epoch 1041
Validation auc = 0.637191
Epoch 1042
Loss = 8.2196e-03, PNorm = 117.6660, GNorm = 0.4830, lr_0 = 9.4823e-04
Validation auc = 0.637627
Epoch 1043
Validation auc = 0.640898
Epoch 1044
Validation auc = 0.642752
Epoch 1045
Validation auc = 0.650221
Epoch 1046
Validation auc = 0.664777
Epoch 1047
Loss = 5.8049e-03, PNorm = 117.7952, GNorm = 0.2112, lr_0 = 9.4798e-04
Validation auc = 0.625034
Epoch 1048
Validation auc = 0.638936
Epoch 1049
Validation auc = 0.640571
Epoch 1050
Validation auc = 0.629177
Epoch 1051
Loss = 9.6327e-02, PNorm = 118.1799, GNorm = 0.5088, lr_0 = 9.4776e-04
Loss = 4.1333e-02, PNorm = 118.2135, GNorm = 1.0467, lr_0 = 9.4775e-04
Validation auc = 0.622908
Epoch 1052
Validation auc = 0.644769
Epoch 1053
Validation auc = 0.638827
Epoch 1054
Validation auc = 0.629232
Epoch 1055
Validation auc = 0.627160
Epoch 1056
Loss = 1.9258e-02, PNorm = 118.5882, GNorm = 0.2884, lr_0 = 9.4751e-04
Loss = 1.8937e-01, PNorm = 118.6102, GNorm = 4.2678, lr_0 = 9.4749e-04
Validation auc = 0.637845
Epoch 1057
Validation auc = 0.651420
Epoch 1058
Validation auc = 0.656000
Epoch 1059
Validation auc = 0.654528
Epoch 1060
Validation auc = 0.657635
Epoch 1061
Loss = 1.9123e-02, PNorm = 118.8544, GNorm = 0.3172, lr_0 = 9.4728e-04
Validation auc = 0.662324
Epoch 1062
Validation auc = 0.661070
Epoch 1063
Validation auc = 0.659652
Epoch 1064
Validation auc = 0.658071
Epoch 1065
Validation auc = 0.655509
Epoch 1066
Loss = 8.3500e-03, PNorm = 118.9912, GNorm = 0.1523, lr_0 = 9.4702e-04
Validation auc = 0.653928
Epoch 1067
Validation auc = 0.652510
Epoch 1068
Validation auc = 0.652183
Epoch 1069
Validation auc = 0.652674
Epoch 1070
Loss = 7.2920e-02, PNorm = 119.0474, GNorm = 0.9778, lr_0 = 9.4681e-04
Loss = 1.7333e-01, PNorm = 119.0572, GNorm = 5.8395, lr_0 = 9.4679e-04
Validation auc = 0.650166
Epoch 1071
Validation auc = 0.643025
Epoch 1072
Validation auc = 0.623835
Epoch 1073
Validation auc = 0.614240
Epoch 1074
Validation auc = 0.616093
Epoch 1075
Loss = 5.8539e-02, PNorm = 119.2595, GNorm = 0.8006, lr_0 = 9.4657e-04
Validation auc = 0.626233
Epoch 1076
Validation auc = 0.618492
Epoch 1077
Validation auc = 0.612768
Epoch 1078
Validation auc = 0.616748
Epoch 1079
Validation auc = 0.617783
Epoch 1080
Loss = 7.2287e-03, PNorm = 119.4756, GNorm = 0.1068, lr_0 = 9.4632e-04
Validation auc = 0.618547
Epoch 1081
Validation auc = 0.618710
Epoch 1082
Validation auc = 0.621327
Epoch 1083
Validation auc = 0.628469
Epoch 1084
Loss = 2.8484e-03, PNorm = 119.5816, GNorm = 0.0395, lr_0 = 9.4610e-04
Loss = 2.4178e-05, PNorm = 119.5868, GNorm = 0.0009, lr_0 = 9.4608e-04
Validation auc = 0.633321
Epoch 1085
Validation auc = 0.636101
Epoch 1086
Validation auc = 0.635774
Epoch 1087
Validation auc = 0.637028
Epoch 1088
Validation auc = 0.636919
Epoch 1089
Loss = 3.5594e-03, PNorm = 119.6414, GNorm = 0.0370, lr_0 = 9.4585e-04
Loss = 9.9223e-04, PNorm = 119.6445, GNorm = 0.0296, lr_0 = 9.4583e-04
Validation auc = 0.637082
Epoch 1090
Validation auc = 0.636919
Epoch 1091
Validation auc = 0.635828
Epoch 1092
Validation auc = 0.633484
Epoch 1093
Validation auc = 0.631849
Epoch 1094
Loss = 1.9113e-03, PNorm = 119.6712, GNorm = 0.0316, lr_0 = 9.4561e-04
Validation auc = 0.632121
Epoch 1095
Validation auc = 0.633866
Epoch 1096
Validation auc = 0.635937
Epoch 1097
Validation auc = 0.637627
Epoch 1098
Validation auc = 0.638936
Epoch 1099
Loss = 3.6351e-03, PNorm = 119.7024, GNorm = 0.0734, lr_0 = 9.4536e-04
Validation auc = 0.640026
Epoch 1100
Validation auc = 0.639426
Epoch 1101
Validation auc = 0.641007
Epoch 1102
Validation auc = 0.639699
Epoch 1103
Loss = 3.3655e-02, PNorm = 119.7198, GNorm = 0.6882, lr_0 = 9.4515e-04
Loss = 1.9074e-03, PNorm = 119.7207, GNorm = 0.0559, lr_0 = 9.4513e-04
Validation auc = 0.636973
Epoch 1104
Validation auc = 0.636101
Epoch 1105
Validation auc = 0.635174
Epoch 1106
Validation auc = 0.634138
Epoch 1107
Validation auc = 0.631522
Epoch 1108
Loss = 1.6718e-03, PNorm = 119.7673, GNorm = 0.0264, lr_0 = 9.4489e-04
Validation auc = 0.628578
Epoch 1109
Validation auc = 0.627542
Epoch 1110
Validation auc = 0.626942
Epoch 1111
Validation auc = 0.626670
Epoch 1112
Validation auc = 0.626724
Epoch 1113
Loss = 9.3000e-03, PNorm = 119.7964, GNorm = 0.3826, lr_0 = 9.4466e-04
Validation auc = 0.627978
Epoch 1114
Validation auc = 0.628741
Epoch 1115
Validation auc = 0.628578
Epoch 1116
Validation auc = 0.628142
Epoch 1117
Loss = 9.1017e-04, PNorm = 119.8156, GNorm = 0.0066, lr_0 = 9.4444e-04
Loss = 2.8964e-04, PNorm = 119.8167, GNorm = 0.0103, lr_0 = 9.4443e-04
Validation auc = 0.628196
Epoch 1118
Validation auc = 0.627814
Epoch 1119
Validation auc = 0.628687
Epoch 1120
Validation auc = 0.628850
Epoch 1121
Validation auc = 0.628741
Epoch 1122
Loss = 5.4401e-02, PNorm = 119.8310, GNorm = 0.0144, lr_0 = 9.4419e-04
Loss = 1.0331e-06, PNorm = 119.8314, GNorm = 0.0000, lr_0 = 9.4417e-04
Validation auc = 0.627651
Epoch 1123
Validation auc = 0.624652
Epoch 1124
Validation auc = 0.622417
Epoch 1125
Validation auc = 0.621872
Epoch 1126
Validation auc = 0.622199
Epoch 1127
Loss = 5.1051e-03, PNorm = 119.8664, GNorm = 0.1146, lr_0 = 9.4396e-04
Validation auc = 0.623235
Epoch 1128
Validation auc = 0.623399
Epoch 1129
Validation auc = 0.623998
Epoch 1130
Validation auc = 0.623344
Epoch 1131
Validation auc = 0.622145
Epoch 1132
Loss = 1.1847e-03, PNorm = 119.9096, GNorm = 0.0255, lr_0 = 9.4371e-04
Validation auc = 0.623017
Epoch 1133
Validation auc = 0.622690
Epoch 1134
Validation auc = 0.623235
Epoch 1135
Validation auc = 0.623290
Epoch 1136
Loss = 1.2860e-02, PNorm = 119.9382, GNorm = 0.4774, lr_0 = 9.4349e-04
Loss = 3.7209e-04, PNorm = 119.9403, GNorm = 0.0094, lr_0 = 9.4347e-04
Validation auc = 0.623998
Epoch 1137
Validation auc = 0.624761
Epoch 1138
Validation auc = 0.624216
Epoch 1139
Validation auc = 0.623071
Epoch 1140
Validation auc = 0.622853
Epoch 1141
Loss = 3.4838e-03, PNorm = 119.9551, GNorm = 0.2144, lr_0 = 9.4324e-04
Validation auc = 0.621927
Epoch 1142
Validation auc = 0.622145
Epoch 1143
Validation auc = 0.622635
Epoch 1144
Validation auc = 0.622581
Epoch 1145
Validation auc = 0.622090
Epoch 1146
Loss = 9.8577e-04, PNorm = 119.9742, GNorm = 0.0183, lr_0 = 9.4300e-04
Validation auc = 0.621981
Epoch 1147
Validation auc = 0.621600
Epoch 1148
Validation auc = 0.620945
Epoch 1149
Validation auc = 0.622417
Epoch 1150
Loss = 2.3081e-03, PNorm = 119.9926, GNorm = 0.0167, lr_0 = 9.4279e-04
Loss = 1.0351e-05, PNorm = 119.9943, GNorm = 0.0006, lr_0 = 9.4277e-04
Validation auc = 0.624925
Epoch 1151
Validation auc = 0.628796
Epoch 1152
Validation auc = 0.633266
Epoch 1153
Validation auc = 0.636265
Epoch 1154
Validation auc = 0.638936
Epoch 1155
Loss = 1.5732e-03, PNorm = 120.0172, GNorm = 0.1218, lr_0 = 9.4253e-04
Loss = 1.1963e-04, PNorm = 120.0185, GNorm = 0.0070, lr_0 = 9.4252e-04
Validation auc = 0.639536
Epoch 1156
Validation auc = 0.639481
Epoch 1157
Validation auc = 0.639426
Epoch 1158
Validation auc = 0.638391
Epoch 1159
Validation auc = 0.634956
Epoch 1160
Loss = 2.5624e-04, PNorm = 120.0366, GNorm = 0.0067, lr_0 = 9.4230e-04
Validation auc = 0.632230
Epoch 1161
Validation auc = 0.630213
Epoch 1162
Validation auc = 0.629395
Epoch 1163
Validation auc = 0.629450
Epoch 1164
Validation auc = 0.629886
Epoch 1165
Loss = 7.5280e-05, PNorm = 120.0540, GNorm = 0.0017, lr_0 = 9.4205e-04
Validation auc = 0.630758
Epoch 1166
Validation auc = 0.627978
Epoch 1167
Validation auc = 0.626397
Epoch 1168
Validation auc = 0.626997
Epoch 1169
Loss = 2.6317e-03, PNorm = 120.0613, GNorm = 0.1621, lr_0 = 9.4183e-04
Loss = 2.2474e-04, PNorm = 120.0627, GNorm = 0.0100, lr_0 = 9.4182e-04
Validation auc = 0.629123
Epoch 1170
Validation auc = 0.629886
Epoch 1171
Validation auc = 0.631194
Epoch 1172
Validation auc = 0.632121
Epoch 1173
Validation auc = 0.632666
Epoch 1174
Loss = 8.2250e-04, PNorm = 120.0907, GNorm = 0.0164, lr_0 = 9.4158e-04
Validation auc = 0.632557
Epoch 1175
Validation auc = 0.633702
Epoch 1176
Validation auc = 0.634247
Epoch 1177
Validation auc = 0.634247
Epoch 1178
Validation auc = 0.634411
Epoch 1179
Loss = 1.5748e-04, PNorm = 120.1044, GNorm = 0.0029, lr_0 = 9.4135e-04
Validation auc = 0.633757
Epoch 1180
Validation auc = 0.632612
Epoch 1181
Validation auc = 0.632339
Epoch 1182
Validation auc = 0.631522
Epoch 1183
Loss = 1.4025e-02, PNorm = 120.1100, GNorm = 0.0195, lr_0 = 9.4112e-04
Validation auc = 0.625579
Epoch 1184
Validation auc = 0.621654
Epoch 1185
Validation auc = 0.621163
Epoch 1186
Validation auc = 0.622199
Epoch 1187
Validation auc = 0.619473
Epoch 1188
Loss = 8.7101e-03, PNorm = 120.1570, GNorm = 0.8567, lr_0 = 9.4088e-04
Loss = 9.5202e-04, PNorm = 120.1624, GNorm = 0.0371, lr_0 = 9.4087e-04
Validation auc = 0.615603
Epoch 1189
Validation auc = 0.610969
Epoch 1190
Validation auc = 0.608516
Epoch 1191
Validation auc = 0.607153
Epoch 1192
Validation auc = 0.607425
Epoch 1193
Loss = 1.8109e-04, PNorm = 120.2174, GNorm = 0.0036, lr_0 = 9.4065e-04
Validation auc = 0.607098
Epoch 1194
Validation auc = 0.620727
Epoch 1195
Validation auc = 0.625470
Epoch 1196
Validation auc = 0.628687
Epoch 1197
Validation auc = 0.630540
Epoch 1198
Loss = 3.9959e-03, PNorm = 120.2908, GNorm = 0.1105, lr_0 = 9.4040e-04
Validation auc = 0.630976
Epoch 1199
Validation auc = 0.631358
Epoch 1200
Validation auc = 0.632176
Epoch 1201
Validation auc = 0.633648
Epoch 1202
Loss = 6.0271e-03, PNorm = 120.3341, GNorm = 0.0209, lr_0 = 9.4018e-04
Loss = 7.8482e-05, PNorm = 120.3368, GNorm = 0.0043, lr_0 = 9.4016e-04
Validation auc = 0.634138
Epoch 1203
Validation auc = 0.634302
Epoch 1204
Validation auc = 0.633321
Epoch 1205
Validation auc = 0.633103
Epoch 1206
Validation auc = 0.632939
Epoch 1207
Loss = 1.0205e-03, PNorm = 120.3762, GNorm = 0.0211, lr_0 = 9.3993e-04
Loss = 1.4923e-02, PNorm = 120.3792, GNorm = 0.6935, lr_0 = 9.3991e-04
Validation auc = 0.635283
Epoch 1208
Validation auc = 0.639154
Epoch 1209
Validation auc = 0.641607
Epoch 1210
Validation auc = 0.642043
Epoch 1211
Validation auc = 0.642534
Epoch 1212
Loss = 7.1329e-05, PNorm = 120.4125, GNorm = 0.0015, lr_0 = 9.3970e-04
Validation auc = 0.643406
Epoch 1213
Validation auc = 0.643624
Epoch 1214
Validation auc = 0.643243
Epoch 1215
Validation auc = 0.642861
Epoch 1216
Loss = 2.0372e-04, PNorm = 120.4302, GNorm = 0.0288, lr_0 = 9.3946e-04
Validation auc = 0.643570
Epoch 1217
Validation auc = 0.643897
Epoch 1218
Validation auc = 0.643733
Epoch 1219
Validation auc = 0.643025
Epoch 1220
Validation auc = 0.642916
Epoch 1221
Loss = 2.0463e-04, PNorm = 120.4374, GNorm = 0.0046, lr_0 = 9.3923e-04
Loss = 3.3914e-04, PNorm = 120.4378, GNorm = 0.0116, lr_0 = 9.3922e-04
Validation auc = 0.642588
Epoch 1222
Validation auc = 0.642425
Epoch 1223
Validation auc = 0.642207
Epoch 1224
Validation auc = 0.642043
Epoch 1225
Validation auc = 0.642043
Epoch 1226
Loss = 1.6890e-04, PNorm = 120.4420, GNorm = 0.0036, lr_0 = 9.3900e-04
Validation auc = 0.642098
Epoch 1227
Validation auc = 0.641934
Epoch 1228
Validation auc = 0.640680
Epoch 1229
Validation auc = 0.640517
Epoch 1230
Validation auc = 0.640135
Epoch 1231
Loss = 1.4269e-04, PNorm = 120.4495, GNorm = 0.0033, lr_0 = 9.3875e-04
Validation auc = 0.640244
Epoch 1232
Validation auc = 0.639699
Epoch 1233
Validation auc = 0.639372
Epoch 1234
Validation auc = 0.639372
Epoch 1235
Loss = 1.4733e-04, PNorm = 120.4550, GNorm = 0.0033, lr_0 = 9.3853e-04
Loss = 5.5900e-05, PNorm = 120.4553, GNorm = 0.0025, lr_0 = 9.3852e-04
Validation auc = 0.639045
Epoch 1236
Validation auc = 0.638827
Epoch 1237
Validation auc = 0.638445
Epoch 1238
Validation auc = 0.638609
Epoch 1239
Validation auc = 0.638500
Epoch 1240
Loss = 1.1859e-04, PNorm = 120.4595, GNorm = 0.0032, lr_0 = 9.3828e-04
Loss = 3.5763e-07, PNorm = 120.4597, GNorm = 0.0000, lr_0 = 9.3827e-04
Validation auc = 0.638554
Epoch 1241
Validation auc = 0.638663
Epoch 1242
Validation auc = 0.638445
Epoch 1243
Validation auc = 0.638554
Epoch 1244
Validation auc = 0.637791
Epoch 1245
Loss = 1.0157e-03, PNorm = 120.4646, GNorm = 0.0490, lr_0 = 9.3805e-04
Validation auc = 0.638282
Epoch 1246
Validation auc = 0.638336
Epoch 1247
Validation auc = 0.637573
Epoch 1248
Validation auc = 0.637082
Epoch 1249
Loss = 1.0297e-03, PNorm = 120.4872, GNorm = 0.0339, lr_0 = 9.3782e-04
Validation auc = 0.635174
Epoch 1250
Validation auc = 0.635229
Epoch 1251
Validation auc = 0.635501
Epoch 1252
Validation auc = 0.635828
Epoch 1253
Validation auc = 0.635392
Epoch 1254
Loss = 1.2337e-04, PNorm = 120.5060, GNorm = 0.0030, lr_0 = 9.3758e-04
Loss = 1.4565e-03, PNorm = 120.5072, GNorm = 0.0433, lr_0 = 9.3757e-04
Validation auc = 0.635447
Epoch 1255
Validation auc = 0.635447
Epoch 1256
Validation auc = 0.634956
Epoch 1257
Validation auc = 0.634738
Epoch 1258
Validation auc = 0.634574
Epoch 1259
Loss = 5.1819e-04, PNorm = 120.5175, GNorm = 0.0257, lr_0 = 9.3735e-04
Validation auc = 0.634574
Epoch 1260
Validation auc = 0.634684
Epoch 1261
Validation auc = 0.634684
Epoch 1262
Validation auc = 0.634793
Epoch 1263
Validation auc = 0.634793
Epoch 1264
Loss = 1.5691e-04, PNorm = 120.5259, GNorm = 0.0039, lr_0 = 9.3710e-04
Validation auc = 0.634847
Epoch 1265
Validation auc = 0.635065
Epoch 1266
Validation auc = 0.635011
Epoch 1267
Validation auc = 0.635120
Epoch 1268
Loss = 7.5681e-02, PNorm = 120.5299, GNorm = 0.0022, lr_0 = 9.3689e-04
Loss = 3.2655e-04, PNorm = 120.5307, GNorm = 0.0196, lr_0 = 9.3687e-04
Validation auc = 0.632884
Epoch 1269
Validation auc = 0.632012
Epoch 1270
Validation auc = 0.636374
Epoch 1271
Validation auc = 0.639045
Epoch 1272
Validation auc = 0.639863
Epoch 1273
Loss = 2.4446e-04, PNorm = 120.5503, GNorm = 0.0017, lr_0 = 9.3664e-04
Loss = 3.2702e-05, PNorm = 120.5518, GNorm = 0.0011, lr_0 = 9.3662e-04
Validation auc = 0.640953
Epoch 1274
Validation auc = 0.641498
Epoch 1275
Validation auc = 0.641989
Epoch 1276
Validation auc = 0.642425
Epoch 1277
Validation auc = 0.642970
Epoch 1278
Loss = 7.6632e-03, PNorm = 120.5663, GNorm = 0.2790, lr_0 = 9.3641e-04
Validation auc = 0.643624
Epoch 1279
Validation auc = 0.644388
Epoch 1280
Validation auc = 0.645205
Epoch 1281
Validation auc = 0.646187
Epoch 1282
Validation auc = 0.645750
Epoch 1283
Loss = 2.8914e-03, PNorm = 120.5935, GNorm = 0.0870, lr_0 = 9.3616e-04
Validation auc = 0.646623
Epoch 1284
Validation auc = 0.647549
Epoch 1285
Validation auc = 0.647822
Epoch 1286
Validation auc = 0.645641
Epoch 1287
Loss = 1.2313e-03, PNorm = 120.6386, GNorm = 0.0177, lr_0 = 9.3594e-04
Loss = 3.3945e-04, PNorm = 120.6413, GNorm = 0.0109, lr_0 = 9.3592e-04
Validation auc = 0.642425
Epoch 1288
Validation auc = 0.641117
Epoch 1289
Validation auc = 0.640299
Epoch 1290
Validation auc = 0.639645
Epoch 1291
Validation auc = 0.639972
Epoch 1292
Loss = 2.1324e-03, PNorm = 120.6675, GNorm = 0.0790, lr_0 = 9.3571e-04
Validation auc = 0.640408
Epoch 1293
Validation auc = 0.641062
Epoch 1294
Validation auc = 0.642207
Epoch 1295
Validation auc = 0.644278
Epoch 1296
Validation auc = 0.645369
Epoch 1297
Loss = 2.1788e-04, PNorm = 120.6807, GNorm = 0.0062, lr_0 = 9.3546e-04
Validation auc = 0.646296
Epoch 1298
Validation auc = 0.646950
Epoch 1299
Validation auc = 0.647222
Epoch 1300
Validation auc = 0.648149
Epoch 1301
Loss = 4.0401e-04, PNorm = 120.6929, GNorm = 0.0057, lr_0 = 9.3524e-04
Loss = 1.3259e-03, PNorm = 120.6938, GNorm = 0.0579, lr_0 = 9.3523e-04
Validation auc = 0.648040
Epoch 1302
Validation auc = 0.647331
Epoch 1303
Validation auc = 0.647549
Epoch 1304
Validation auc = 0.647331
Epoch 1305
Validation auc = 0.647004
Epoch 1306
Loss = 4.7008e-04, PNorm = 120.7050, GNorm = 0.0050, lr_0 = 9.3499e-04
Loss = 1.9033e-05, PNorm = 120.7057, GNorm = 0.0010, lr_0 = 9.3498e-04
Validation auc = 0.647004
Epoch 1307
Validation auc = 0.646841
Epoch 1308
Validation auc = 0.646950
Epoch 1309
Validation auc = 0.644169
Epoch 1310
Validation auc = 0.641607
Epoch 1311
Loss = 1.4229e-03, PNorm = 120.7128, GNorm = 0.0645, lr_0 = 9.3476e-04
Validation auc = 0.639481
Epoch 1312
Validation auc = 0.638609
Epoch 1313
Validation auc = 0.640898
Epoch 1314
Validation auc = 0.642043
Epoch 1315
Validation auc = 0.643624
Epoch 1316
Loss = 8.4446e-02, PNorm = 120.7224, GNorm = 1.1209, lr_0 = 9.3451e-04
Validation auc = 0.646296
Epoch 1317
Validation auc = 0.645205
Epoch 1318
Validation auc = 0.642316
Epoch 1319
Validation auc = 0.641171
Epoch 1320
Loss = 7.4308e-04, PNorm = 120.7270, GNorm = 0.0340, lr_0 = 9.3430e-04
Loss = 2.2548e-04, PNorm = 120.7280, GNorm = 0.0085, lr_0 = 9.3428e-04
Validation auc = 0.640244
Epoch 1321
Validation auc = 0.640244
Epoch 1322
Validation auc = 0.639972
Epoch 1323
Validation auc = 0.638718
Epoch 1324
Validation auc = 0.638500
Epoch 1325
Loss = 3.9223e-04, PNorm = 120.7375, GNorm = 0.0101, lr_0 = 9.3407e-04
Validation auc = 0.638282
Epoch 1326
Validation auc = 0.638282
Epoch 1327
Validation auc = 0.638227
Epoch 1328
Validation auc = 0.638227
Epoch 1329
Validation auc = 0.638282
Epoch 1330
Loss = 1.3531e-04, PNorm = 120.7428, GNorm = 0.0030, lr_0 = 9.3382e-04
Validation auc = 0.638336
Epoch 1331
Validation auc = 0.636319
Epoch 1332
Validation auc = 0.633757
Epoch 1333
Validation auc = 0.631140
Epoch 1334
Loss = 2.2200e-04, PNorm = 120.7530, GNorm = 0.0110, lr_0 = 9.3360e-04
Loss = 8.7002e-05, PNorm = 120.7541, GNorm = 0.0034, lr_0 = 9.3359e-04
Validation auc = 0.629232
Epoch 1335
Validation auc = 0.627433
Epoch 1336
Validation auc = 0.625961
Epoch 1337
Validation auc = 0.623889
Epoch 1338
Validation auc = 0.622036
Epoch 1339
Loss = 1.0660e-03, PNorm = 120.7885, GNorm = 0.0697, lr_0 = 9.3336e-04
Loss = 6.8299e-05, PNorm = 120.7917, GNorm = 0.0039, lr_0 = 9.3334e-04
Validation auc = 0.621163
Epoch 1340
Validation auc = 0.622308
Epoch 1341
Validation auc = 0.626888
Epoch 1342
Validation auc = 0.631194
Epoch 1343
Validation auc = 0.634029
Epoch 1344
Loss = 4.3423e-04, PNorm = 120.8335, GNorm = 0.0074, lr_0 = 9.3312e-04
Validation auc = 0.636046
Epoch 1345
Validation auc = 0.637900
Epoch 1346
Validation auc = 0.638282
Epoch 1347
Validation auc = 0.636537
Epoch 1348
Validation auc = 0.635338
Epoch 1349
Loss = 2.7959e-04, PNorm = 120.8568, GNorm = 0.0062, lr_0 = 9.3288e-04
Validation auc = 0.635065
Epoch 1350
Validation auc = 0.634684
Epoch 1351
Validation auc = 0.634411
Epoch 1352
Validation auc = 0.634193
Epoch 1353
Loss = 1.6586e-04, PNorm = 120.8658, GNorm = 0.0039, lr_0 = 9.3266e-04
Loss = 8.6316e-05, PNorm = 120.8663, GNorm = 0.0036, lr_0 = 9.3264e-04
Validation auc = 0.633920
Epoch 1354
Validation auc = 0.633811
Epoch 1355
Validation auc = 0.633484
Epoch 1356
Validation auc = 0.633430
Epoch 1357
Validation auc = 0.633103
Epoch 1358
Loss = 3.1723e-04, PNorm = 120.8717, GNorm = 0.0138, lr_0 = 9.3241e-04
Validation auc = 0.632939
Epoch 1359
Validation auc = 0.632775
Epoch 1360
Validation auc = 0.632666
Epoch 1361
Validation auc = 0.632394
Epoch 1362
Validation auc = 0.632448
Epoch 1363
Loss = 3.0815e-05, PNorm = 120.8759, GNorm = 0.0008, lr_0 = 9.3218e-04
Validation auc = 0.632394
Epoch 1364
Validation auc = 0.632067
Epoch 1365
Validation auc = 0.632067
Epoch 1366
Validation auc = 0.631903
Epoch 1367
Loss = 2.4120e-03, PNorm = 120.8794, GNorm = 0.1084, lr_0 = 9.3197e-04
Loss = 9.8066e-05, PNorm = 120.8797, GNorm = 0.0036, lr_0 = 9.3195e-04
Validation auc = 0.630922
Epoch 1368
Validation auc = 0.629832
Epoch 1369
Validation auc = 0.629286
Epoch 1370
Validation auc = 0.628796
Epoch 1371
Validation auc = 0.628632
Epoch 1372
Loss = 1.5200e-04, PNorm = 120.8873, GNorm = 0.0051, lr_0 = 9.3172e-04
Loss = 1.1722e-05, PNorm = 120.8880, GNorm = 0.0007, lr_0 = 9.3170e-04
Validation auc = 0.629395
Epoch 1373
Validation auc = 0.629559
Epoch 1374
Validation auc = 0.629450
Epoch 1375
Validation auc = 0.629177
Epoch 1376
Validation auc = 0.628796
Epoch 1377
Loss = 4.9928e-04, PNorm = 120.8970, GNorm = 0.0184, lr_0 = 9.3149e-04
Validation auc = 0.628632
Epoch 1378
Validation auc = 0.627869
Epoch 1379
Validation auc = 0.627596
Epoch 1380
Validation auc = 0.627869
Epoch 1381
Validation auc = 0.628087
Epoch 1382
Loss = 3.8568e-04, PNorm = 120.9070, GNorm = 0.0130, lr_0 = 9.3124e-04
Validation auc = 0.628414
Epoch 1383
Validation auc = 0.628578
Epoch 1384
Validation auc = 0.628196
Epoch 1385
Validation auc = 0.627923
Epoch 1386
Loss = 6.1275e-04, PNorm = 120.9195, GNorm = 0.0287, lr_0 = 9.3102e-04
Loss = 9.7655e-05, PNorm = 120.9204, GNorm = 0.0046, lr_0 = 9.3101e-04
Validation auc = 0.627705
Epoch 1387
Validation auc = 0.627487
Epoch 1388
Validation auc = 0.627378
Epoch 1389
Validation auc = 0.627378
Epoch 1390
Validation auc = 0.627378
Epoch 1391
Loss = 9.6945e-05, PNorm = 120.9302, GNorm = 0.0039, lr_0 = 9.3078e-04
Validation auc = 0.626942
Epoch 1392
Validation auc = 0.626888
Epoch 1393
Validation auc = 0.626452
Epoch 1394
Validation auc = 0.626070
Epoch 1395
Validation auc = 0.625743
Epoch 1396
Loss = 6.9727e-05, PNorm = 120.9362, GNorm = 0.0016, lr_0 = 9.3055e-04
Validation auc = 0.625525
Epoch 1397
Validation auc = 0.625470
Epoch 1398
Validation auc = 0.625470
Epoch 1399
Validation auc = 0.625470
Epoch 1400
Loss = 1.1892e-04, PNorm = 120.9403, GNorm = 0.0081, lr_0 = 9.3033e-04
Loss = 1.6221e-04, PNorm = 120.9405, GNorm = 0.0091, lr_0 = 9.3032e-04
Validation auc = 0.625416
Epoch 1401
Validation auc = 0.625416
Epoch 1402
Validation auc = 0.625307
Epoch 1403
Validation auc = 0.625143
Epoch 1404
Validation auc = 0.625198
Epoch 1405
Loss = 6.6737e-05, PNorm = 120.9434, GNorm = 0.0012, lr_0 = 9.3008e-04
Loss = 1.4305e-05, PNorm = 120.9436, GNorm = 0.0006, lr_0 = 9.3007e-04
Validation auc = 0.625252
Epoch 1406
Validation auc = 0.625252
Epoch 1407
Validation auc = 0.625252
Epoch 1408
Validation auc = 0.625361
Epoch 1409
Validation auc = 0.625525
Epoch 1410
Loss = 3.0471e-05, PNorm = 120.9452, GNorm = 0.0008, lr_0 = 9.2985e-04
Validation auc = 0.625525
Epoch 1411
Validation auc = 0.625634
Epoch 1412
Validation auc = 0.625579
Epoch 1413
Validation auc = 0.625634
Epoch 1414
Validation auc = 0.625634
Epoch 1415
Loss = 4.0998e-05, PNorm = 120.9468, GNorm = 0.0011, lr_0 = 9.2961e-04
Validation auc = 0.625634
Epoch 1416
Validation auc = 0.625688
Epoch 1417
Validation auc = 0.625852
Epoch 1418
Validation auc = 0.626015
Epoch 1419
Loss = 3.8537e-05, PNorm = 120.9486, GNorm = 0.0006, lr_0 = 9.2939e-04
Loss = 1.2775e-05, PNorm = 120.9487, GNorm = 0.0008, lr_0 = 9.2938e-04
Validation auc = 0.626070
Epoch 1420
Validation auc = 0.625961
Epoch 1421
Validation auc = 0.626179
Epoch 1422
Validation auc = 0.626179
Epoch 1423
Validation auc = 0.626288
Epoch 1424
Loss = 2.9456e-05, PNorm = 120.9510, GNorm = 0.0010, lr_0 = 9.2914e-04
Validation auc = 0.626397
Epoch 1425
Validation auc = 0.626397
Epoch 1426
Validation auc = 0.626397
Epoch 1427
Validation auc = 0.626342
Epoch 1428
Validation auc = 0.626179
Epoch 1429
Loss = 2.2292e-05, PNorm = 120.9532, GNorm = 0.0005, lr_0 = 9.2891e-04
Validation auc = 0.625906
Epoch 1430
Validation auc = 0.625797
Epoch 1431
Validation auc = 0.625634
Epoch 1432
Validation auc = 0.625634
Epoch 1433
Loss = 4.3678e-05, PNorm = 120.9553, GNorm = 0.0014, lr_0 = 9.2868e-04
Validation auc = 0.625688
Epoch 1434
Validation auc = 0.625797
Epoch 1435
Validation auc = 0.626015
Epoch 1436
Validation auc = 0.626179
Epoch 1437
Validation auc = 0.626288
Epoch 1438
Loss = 6.0541e-04, PNorm = 120.9569, GNorm = 0.0410, lr_0 = 9.2845e-04
Loss = 8.7816e-06, PNorm = 120.9571, GNorm = 0.0004, lr_0 = 9.2844e-04
Validation auc = 0.626070
Epoch 1439
Validation auc = 0.626124
Epoch 1440
Validation auc = 0.626015
Epoch 1441
Validation auc = 0.625852
Epoch 1442
Validation auc = 0.625852
Epoch 1443
Loss = 4.7033e-05, PNorm = 120.9593, GNorm = 0.0016, lr_0 = 9.2822e-04
Validation auc = 0.625634
Epoch 1444
Validation auc = 0.625579
Epoch 1445
Validation auc = 0.626288
Epoch 1446
Validation auc = 0.626342
Epoch 1447
Validation auc = 0.626670
Epoch 1448
Loss = 9.3984e-05, PNorm = 120.9612, GNorm = 0.0033, lr_0 = 9.2798e-04
Validation auc = 0.626452
Epoch 1449
Validation auc = 0.626452
Epoch 1450
Validation auc = 0.626397
Epoch 1451
Validation auc = 0.626124
Epoch 1452
Loss = 1.6815e-04, PNorm = 120.9640, GNorm = 0.0087, lr_0 = 9.2776e-04
Loss = 7.2016e-05, PNorm = 120.9642, GNorm = 0.0032, lr_0 = 9.2775e-04
Validation auc = 0.625961
Epoch 1453
Validation auc = 0.626724
Epoch 1454
Validation auc = 0.627051
Epoch 1455
Validation auc = 0.627433
Epoch 1456
Validation auc = 0.627215
Epoch 1457
Loss = 1.2291e-04, PNorm = 120.9679, GNorm = 0.0057, lr_0 = 9.2752e-04
Loss = 2.7556e-05, PNorm = 120.9682, GNorm = 0.0014, lr_0 = 9.2750e-04
Validation auc = 0.626942
Epoch 1458
Validation auc = 0.626397
Epoch 1459
Validation auc = 0.626233
Epoch 1460
Validation auc = 0.626015
Epoch 1461
Validation auc = 0.625743
Epoch 1462
Loss = 6.1061e-05, PNorm = 120.9723, GNorm = 0.0014, lr_0 = 9.2729e-04
Validation auc = 0.625852
Epoch 1463
Validation auc = 0.625797
Epoch 1464
Validation auc = 0.625852
Epoch 1465
Validation auc = 0.626015
Epoch 1466
Loss = 1.1445e-03, PNorm = 120.9751, GNorm = 0.0003, lr_0 = 9.2706e-04
Validation auc = 0.626997
Epoch 1467
Validation auc = 0.627651
Epoch 1468
Validation auc = 0.628469
Epoch 1469
Validation auc = 0.629286
Epoch 1470
Validation auc = 0.629941
Epoch 1471
Loss = 6.1242e-05, PNorm = 120.9811, GNorm = 0.0010, lr_0 = 9.2683e-04
Loss = 1.5891e-04, PNorm = 120.9816, GNorm = 0.0069, lr_0 = 9.2681e-04
Validation auc = 0.629777
Epoch 1472
Validation auc = 0.629504
Epoch 1473
Validation auc = 0.629504
Epoch 1474
Validation auc = 0.629341
Epoch 1475
Validation auc = 0.629014
Epoch 1476
Loss = 3.7677e-04, PNorm = 120.9862, GNorm = 0.0200, lr_0 = 9.2660e-04
Validation auc = 0.629014
Epoch 1477
Validation auc = 0.628741
Epoch 1478
Validation auc = 0.629123
Epoch 1479
Validation auc = 0.630050
Epoch 1480
Validation auc = 0.630540
Epoch 1481
Loss = 4.6071e-05, PNorm = 120.9901, GNorm = 0.0013, lr_0 = 9.2635e-04
Validation auc = 0.630758
Epoch 1482
Validation auc = 0.630377
Epoch 1483
Validation auc = 0.630213
Epoch 1484
Validation auc = 0.629723
Epoch 1485
Loss = 2.8323e-04, PNorm = 120.9942, GNorm = 0.0021, lr_0 = 9.2614e-04
Loss = 1.1639e-04, PNorm = 120.9946, GNorm = 0.0042, lr_0 = 9.2612e-04
Validation auc = 0.629395
Epoch 1486
Validation auc = 0.629014
Epoch 1487
Validation auc = 0.628741
Epoch 1488
Validation auc = 0.628469
Epoch 1489
Validation auc = 0.628523
Epoch 1490
Loss = 1.2761e-04, PNorm = 120.9993, GNorm = 0.0014, lr_0 = 9.2589e-04
Loss = 1.1880e-04, PNorm = 120.9996, GNorm = 0.0051, lr_0 = 9.2587e-04
Validation auc = 0.628032
Epoch 1491
Validation auc = 0.628032
Epoch 1492
Validation auc = 0.627978
Epoch 1493
Validation auc = 0.628632
Epoch 1494
Validation auc = 0.628578
Epoch 1495
Loss = 4.7220e-05, PNorm = 121.0029, GNorm = 0.0014, lr_0 = 9.2566e-04
Validation auc = 0.628850
Epoch 1496
Validation auc = 0.628959
Epoch 1497
Validation auc = 0.629395
Epoch 1498
Validation auc = 0.629395
Epoch 1499
Loss = 4.4834e-05, PNorm = 121.0047, GNorm = 0.0062, lr_0 = 9.2543e-04
Validation auc = 0.629613
Epoch 1500
Validation auc = 0.629941
Epoch 1501
Validation auc = 0.630213
Epoch 1502
Validation auc = 0.630431
Epoch 1503
Validation auc = 0.630377
Epoch 1504
Loss = 4.9373e-05, PNorm = 121.0067, GNorm = 0.0013, lr_0 = 9.2520e-04
Loss = 0.0000e+00, PNorm = 121.0068, GNorm = 0.0000, lr_0 = 9.2518e-04
Validation auc = 0.630159
Epoch 1505
Validation auc = 0.630213
Epoch 1506
Validation auc = 0.630268
Epoch 1507
Validation auc = 0.630104
Epoch 1508
Validation auc = 0.630377
Epoch 1509
Loss = 4.1644e-05, PNorm = 121.0085, GNorm = 0.0013, lr_0 = 9.2497e-04
Validation auc = 0.630268
Epoch 1510
Validation auc = 0.630268
Epoch 1511
Validation auc = 0.630377
Epoch 1512
Validation auc = 0.630540
Epoch 1513
Validation auc = 0.630213
Epoch 1514
Loss = 2.4501e-05, PNorm = 121.0106, GNorm = 0.0007, lr_0 = 9.2472e-04
Validation auc = 0.629941
Epoch 1515
Validation auc = 0.629832
Epoch 1516
Validation auc = 0.630159
Epoch 1517
Validation auc = 0.630159
Epoch 1518
Loss = 2.1793e-05, PNorm = 121.0131, GNorm = 0.0006, lr_0 = 9.2451e-04
Loss = 9.1021e-05, PNorm = 121.0134, GNorm = 0.0067, lr_0 = 9.2449e-04
Validation auc = 0.630050
Epoch 1519
Validation auc = 0.630159
Epoch 1520
Validation auc = 0.630322
Epoch 1521
Validation auc = 0.629995
Epoch 1522
Validation auc = 0.629613
Epoch 1523
Loss = 2.1405e-05, PNorm = 121.0165, GNorm = 0.0006, lr_0 = 9.2427e-04
Loss = 3.0597e-06, PNorm = 121.0167, GNorm = 0.0002, lr_0 = 9.2425e-04
Validation auc = 0.629450
Epoch 1524
Validation auc = 0.629504
Epoch 1525
Validation auc = 0.629232
Epoch 1526
Validation auc = 0.628959
Epoch 1527
Validation auc = 0.628959
Epoch 1528
Loss = 7.2859e-06, PNorm = 121.0185, GNorm = 0.0002, lr_0 = 9.2404e-04
Validation auc = 0.628905
Epoch 1529
Validation auc = 0.628687
Epoch 1530
Validation auc = 0.630813
Epoch 1531
Validation auc = 0.630377
Epoch 1532
Validation auc = 0.626070
Epoch 1533
Loss = 1.8202e-05, PNorm = 121.0298, GNorm = 0.0005, lr_0 = 9.2379e-04
Validation auc = 0.623889
Epoch 1534
Validation auc = 0.622526
Epoch 1535
Validation auc = 0.621981
Epoch 1536
Validation auc = 0.621927
Epoch 1537
Loss = 7.5002e-05, PNorm = 121.0528, GNorm = 0.0053, lr_0 = 9.2358e-04
Loss = 1.9693e-04, PNorm = 121.0540, GNorm = 0.0082, lr_0 = 9.2356e-04
Validation auc = 0.621981
Epoch 1538
Validation auc = 0.621872
Epoch 1539
Validation auc = 0.621927
Epoch 1540
Validation auc = 0.622145
Epoch 1541
Validation auc = 0.622036
Epoch 1542
Loss = 5.4881e-05, PNorm = 121.0629, GNorm = 0.0022, lr_0 = 9.2335e-04
Validation auc = 0.622962
Epoch 1543
Validation auc = 0.625634
Epoch 1544
Validation auc = 0.627215
Epoch 1545
Validation auc = 0.628687
Epoch 1546
Validation auc = 0.629723
Epoch 1547
Loss = 6.5583e-05, PNorm = 121.0715, GNorm = 0.0026, lr_0 = 9.2310e-04
Validation auc = 0.630377
Epoch 1548
Validation auc = 0.631031
Epoch 1549
Validation auc = 0.630813
Epoch 1550
Validation auc = 0.631740
Epoch 1551
Loss = 4.1597e-05, PNorm = 121.0759, GNorm = 0.0020, lr_0 = 9.2289e-04
Loss = 6.5565e-07, PNorm = 121.0762, GNorm = 0.0000, lr_0 = 9.2287e-04
Validation auc = 0.631958
Epoch 1552
Validation auc = 0.632121
Epoch 1553
Validation auc = 0.632230
Epoch 1554
Validation auc = 0.632285
Epoch 1555
Validation auc = 0.632612
Epoch 1556
Loss = 3.6423e-05, PNorm = 121.0797, GNorm = 0.0005, lr_0 = 9.2264e-04
Loss = 5.6678e-05, PNorm = 121.0799, GNorm = 0.0034, lr_0 = 9.2263e-04
Validation auc = 0.632939
Epoch 1557
Validation auc = 0.633048
Epoch 1558
Validation auc = 0.633048
Epoch 1559
Validation auc = 0.632612
Epoch 1560
Validation auc = 0.632394
Epoch 1561
Loss = 4.3547e-05, PNorm = 121.0826, GNorm = 0.0020, lr_0 = 9.2242e-04
Validation auc = 0.632012
Epoch 1562
Validation auc = 0.631849
Epoch 1563
Validation auc = 0.631740
Epoch 1564
Validation auc = 0.631903
Epoch 1565
Validation auc = 0.632012
Epoch 1566
Loss = 2.2738e-05, PNorm = 121.0847, GNorm = 0.0006, lr_0 = 9.2217e-04
Validation auc = 0.632121
Epoch 1567
Validation auc = 0.632121
Epoch 1568
Validation auc = 0.632230
Epoch 1569
Validation auc = 0.632503
Epoch 1570
Loss = 1.9514e-05, PNorm = 121.0879, GNorm = 0.0006, lr_0 = 9.2196e-04
Loss = 8.5879e-05, PNorm = 121.0882, GNorm = 0.0039, lr_0 = 9.2194e-04
Validation auc = 0.632612
Epoch 1571
Validation auc = 0.632775
Epoch 1572
Validation auc = 0.632557
Epoch 1573
Validation auc = 0.632557
Epoch 1574
Validation auc = 0.632394
Epoch 1575
Loss = 5.4673e-05, PNorm = 121.0910, GNorm = 0.0019, lr_0 = 9.2173e-04
Validation auc = 0.629941
Epoch 1576
Validation auc = 0.628905
Epoch 1577
Validation auc = 0.629068
Epoch 1578
Validation auc = 0.628196
Epoch 1579
Validation auc = 0.629504
Epoch 1580
Loss = 9.3048e-03, PNorm = 121.1437, GNorm = 1.3058, lr_0 = 9.2148e-04
Validation auc = 0.628905
Epoch 1581
Validation auc = 0.627814
Epoch 1582
Validation auc = 0.629613
Epoch 1583
Validation auc = 0.629886
Epoch 1584
Loss = 1.6602e-04, PNorm = 121.1722, GNorm = 0.0072, lr_0 = 9.2127e-04
Loss = 1.0309e-04, PNorm = 121.1739, GNorm = 0.0086, lr_0 = 9.2125e-04
Validation auc = 0.629286
Epoch 1585
Validation auc = 0.629777
Epoch 1586
Validation auc = 0.629668
Epoch 1587
Validation auc = 0.630050
Epoch 1588
Validation auc = 0.630050
Epoch 1589
Loss = 1.8488e-03, PNorm = 121.1869, GNorm = 0.0010, lr_0 = 9.2103e-04
Loss = 1.4285e-05, PNorm = 121.1874, GNorm = 0.0009, lr_0 = 9.2101e-04
Validation auc = 0.632176
Epoch 1590
Validation auc = 0.632557
Epoch 1591
Validation auc = 0.626342
Epoch 1592
Validation auc = 0.619528
Epoch 1593
Validation auc = 0.614785
Epoch 1594
Loss = 3.6653e-05, PNorm = 121.2069, GNorm = 0.0012, lr_0 = 9.2080e-04
Validation auc = 0.612114
Epoch 1595
Validation auc = 0.609824
Epoch 1596
Validation auc = 0.607643
Epoch 1597
Validation auc = 0.605190
Epoch 1598
Validation auc = 0.593414
Epoch 1599
Loss = 8.0527e-03, PNorm = 121.2894, GNorm = 0.2805, lr_0 = 9.2055e-04
Validation auc = 0.597667
Epoch 1600
Validation auc = 0.621436
Epoch 1601
Validation auc = 0.628032
Epoch 1602
Validation auc = 0.625579
Epoch 1603
Loss = 4.1836e-03, PNorm = 121.7012, GNorm = 0.0952, lr_0 = 9.2034e-04
Loss = 2.3716e-04, PNorm = 121.7300, GNorm = 0.0094, lr_0 = 9.2032e-04
Validation auc = 0.620618
Epoch 1604
Validation auc = 0.627814
Epoch 1605
Validation auc = 0.625852
Epoch 1606
Validation auc = 0.630540
Epoch 1607
Validation auc = 0.630677
Epoch 1608
Loss = 2.4849e-02, PNorm = 122.1704, GNorm = 2.2536, lr_0 = 9.2010e-04
Validation auc = 0.658616
Epoch 1609
Validation auc = 0.672736
Epoch 1610
Validation auc = 0.674208
Epoch 1611
Validation auc = 0.641335
Epoch 1612
Validation auc = 0.661451
Epoch 1613
Loss = 1.1785e-02, PNorm = 122.7553, GNorm = 0.3398, lr_0 = 9.1987e-04
Validation auc = 0.646786
Epoch 1614
Validation auc = 0.625852
Epoch 1615
Validation auc = 0.625143
Epoch 1616
Validation auc = 0.624598
Epoch 1617
Loss = 2.1389e-02, PNorm = 123.3339, GNorm = 0.6624, lr_0 = 9.1966e-04
Loss = 7.4718e-02, PNorm = 123.3631, GNorm = 2.3124, lr_0 = 9.1964e-04
Validation auc = 0.624980
Epoch 1618
Validation auc = 0.629941
Epoch 1619
Validation auc = 0.640626
Epoch 1620
Validation auc = 0.644442
Epoch 1621
Validation auc = 0.646132
Epoch 1622
Loss = 1.9450e-02, PNorm = 123.7988, GNorm = 1.2576, lr_0 = 9.1941e-04
Loss = 8.9136e-04, PNorm = 123.8199, GNorm = 0.0244, lr_0 = 9.1939e-04
Validation auc = 0.647931
Epoch 1623
Validation auc = 0.645042
Epoch 1624
Validation auc = 0.641280
Epoch 1625
Validation auc = 0.639754
Epoch 1626
Validation auc = 0.639072
Epoch 1627
Loss = 2.0358e-02, PNorm = 124.0379, GNorm = 0.6032, lr_0 = 9.1918e-04
Validation auc = 0.649239
Epoch 1628
Validation auc = 0.658344
Epoch 1629
Validation auc = 0.676007
Epoch 1630
Validation auc = 0.676498
Epoch 1631
Validation auc = 0.671101
Epoch 1632
Loss = 1.0461e-01, PNorm = 124.3813, GNorm = 0.9996, lr_0 = 9.1894e-04
Validation auc = 0.665758
Epoch 1633
Validation auc = 0.659925
Epoch 1634
Validation auc = 0.637955
Epoch 1635
Validation auc = 0.627487
Epoch 1636
Loss = 1.5135e-02, PNorm = 124.8494, GNorm = 0.0941, lr_0 = 9.1873e-04
Loss = 3.5612e-03, PNorm = 124.8844, GNorm = 0.0998, lr_0 = 9.1871e-04
Validation auc = 0.626288
Epoch 1637
Validation auc = 0.628687
Epoch 1638
Validation auc = 0.635065
Epoch 1639
Validation auc = 0.638936
Epoch 1640
Validation auc = 0.639127
Epoch 1641
Loss = 5.7054e-03, PNorm = 125.2225, GNorm = 0.2676, lr_0 = 9.1848e-04
Validation auc = 0.639754
Epoch 1642
Validation auc = 0.641444
Epoch 1643
Validation auc = 0.632503
Epoch 1644
Validation auc = 0.624434
Epoch 1645
Validation auc = 0.601919
Epoch 1646
Loss = 2.2459e-03, PNorm = 125.4064, GNorm = 0.0439, lr_0 = 9.1825e-04
Validation auc = 0.593851
Epoch 1647
Validation auc = 0.591942
Epoch 1648
Validation auc = 0.595104
Epoch 1649
Validation auc = 0.600447
Epoch 1650
Loss = 1.0142e-02, PNorm = 125.6074, GNorm = 0.1166, lr_0 = 9.1804e-04
Loss = 2.4028e-03, PNorm = 125.6189, GNorm = 0.0903, lr_0 = 9.1803e-04
Validation auc = 0.601864
Epoch 1651
Validation auc = 0.602192
Epoch 1652
Validation auc = 0.606662
Epoch 1653
Validation auc = 0.610424
Epoch 1654
Validation auc = 0.612441
Epoch 1655
Loss = 2.4995e-03, PNorm = 125.7343, GNorm = 0.0771, lr_0 = 9.1780e-04
Loss = 2.0469e-03, PNorm = 125.7418, GNorm = 0.1701, lr_0 = 9.1778e-04
Validation auc = 0.618110
Epoch 1656
Validation auc = 0.621545
Epoch 1657
Validation auc = 0.625797
Epoch 1658
Validation auc = 0.626997
Epoch 1659
Validation auc = 0.627324
Epoch 1660
Loss = 2.5080e-03, PNorm = 125.8181, GNorm = 0.0651, lr_0 = 9.1757e-04
Validation auc = 0.630949
Epoch 1661
Validation auc = 0.636891
Epoch 1662
Validation auc = 0.628850
Epoch 1663
Validation auc = 0.650875
Epoch 1664
Validation auc = 0.650930
Epoch 1665
Loss = 2.0952e-01, PNorm = 127.4596, GNorm = 1.1755, lr_0 = 9.1733e-04
Validation auc = 0.637082
Epoch 1666
Validation auc = 0.646296
Epoch 1667
Validation auc = 0.653328
Epoch 1668
Validation auc = 0.653601
Epoch 1669
Loss = 1.0205e-01, PNorm = 128.5185, GNorm = 0.8057, lr_0 = 9.1712e-04
Loss = 6.4129e-03, PNorm = 128.5727, GNorm = 0.1788, lr_0 = 9.1710e-04
Validation auc = 0.654746
Epoch 1670
Validation auc = 0.649676
Epoch 1671
Validation auc = 0.637191
Epoch 1672
Validation auc = 0.648912
Epoch 1673
Validation auc = 0.659598
Epoch 1674
Loss = 6.2490e-02, PNorm = 129.2016, GNorm = 0.5582, lr_0 = 9.1687e-04
Validation auc = 0.656381
Epoch 1675
Validation auc = 0.651311
Epoch 1676
Validation auc = 0.645859
Epoch 1677
Validation auc = 0.642098
Epoch 1678
Validation auc = 0.646568
Epoch 1679
Loss = 4.1245e-02, PNorm = 129.7714, GNorm = 1.2121, lr_0 = 9.1664e-04
Validation auc = 0.645423
Epoch 1680
Validation auc = 0.637736
Epoch 1681
Validation auc = 0.648313
Epoch 1682
Validation auc = 0.653546
Epoch 1683
Loss = 2.2866e-02, PNorm = 130.1977, GNorm = 0.0141, lr_0 = 9.1642e-04
Validation auc = 0.655236
Epoch 1684
Validation auc = 0.654419
Epoch 1685
Validation auc = 0.657799
Epoch 1686
Validation auc = 0.661342
Epoch 1687
Validation auc = 0.665213
Epoch 1688
Loss = 6.3331e-02, PNorm = 130.4571, GNorm = 1.5765, lr_0 = 9.1619e-04
Loss = 5.0527e-03, PNorm = 130.4686, GNorm = 0.2109, lr_0 = 9.1617e-04
Validation auc = 0.651965
Epoch 1689
Validation auc = 0.637845
Epoch 1690
Validation auc = 0.629886
Epoch 1691
Validation auc = 0.629723
Epoch 1692
Validation auc = 0.613586
Epoch 1693
Loss = 9.0516e-03, PNorm = 130.7529, GNorm = 0.1969, lr_0 = 9.1596e-04
Validation auc = 0.607534
Epoch 1694
Validation auc = 0.617892
Epoch 1695
Validation auc = 0.620073
Epoch 1696
Validation auc = 0.620291
Epoch 1697
Validation auc = 0.635610
Epoch 1698
Loss = 1.9961e-02, PNorm = 131.1293, GNorm = 0.4075, lr_0 = 9.1572e-04
Validation auc = 0.642534
Epoch 1699
Validation auc = 0.634902
Epoch 1700
Validation auc = 0.631958
Epoch 1701
Validation auc = 0.625634
Epoch 1702
Loss = 6.4119e-03, PNorm = 131.4018, GNorm = 0.3506, lr_0 = 9.1551e-04
Loss = 1.5949e-02, PNorm = 131.4175, GNorm = 1.0814, lr_0 = 9.1549e-04
Validation auc = 0.626397
Epoch 1703
Validation auc = 0.624598
Epoch 1704
Validation auc = 0.625416
Epoch 1705
Validation auc = 0.626452
Epoch 1706
Validation auc = 0.627215
Epoch 1707
Loss = 7.1320e-03, PNorm = 131.5709, GNorm = 0.2139, lr_0 = 9.1526e-04
Loss = 1.5737e-04, PNorm = 131.5781, GNorm = 0.0060, lr_0 = 9.1525e-04
Validation auc = 0.629723
Epoch 1708
Validation auc = 0.628741
Epoch 1709
Validation auc = 0.620727
Epoch 1710
Validation auc = 0.618438
Epoch 1711
Validation auc = 0.620400
Epoch 1712
Loss = 4.7767e-03, PNorm = 131.6715, GNorm = 0.0812, lr_0 = 9.1504e-04
Validation auc = 0.622690
Epoch 1713
Validation auc = 0.624980
Epoch 1714
Validation auc = 0.629123
Epoch 1715
Validation auc = 0.632994
Epoch 1716
Loss = 1.8841e-02, PNorm = 131.7635, GNorm = 1.5473, lr_0 = 9.1481e-04
Validation auc = 0.641171
Epoch 1717
Validation auc = 0.644060
Epoch 1718
Validation auc = 0.644606
Epoch 1719
Validation auc = 0.646405
Epoch 1720
Validation auc = 0.647331
Epoch 1721
Loss = 3.8914e-03, PNorm = 131.8269, GNorm = 0.1559, lr_0 = 9.1458e-04
Loss = 3.5647e-03, PNorm = 131.8303, GNorm = 0.1011, lr_0 = 9.1457e-04
Validation auc = 0.648422
Epoch 1722
Validation auc = 0.649185
Epoch 1723
Validation auc = 0.650057
Epoch 1724
Validation auc = 0.651856
Epoch 1725
Validation auc = 0.653056
Epoch 1726
Loss = 3.2777e-03, PNorm = 131.8616, GNorm = 0.0620, lr_0 = 9.1436e-04
Validation auc = 0.652674
Epoch 1727
Validation auc = 0.653001
Epoch 1728
Validation auc = 0.652620
Epoch 1729
Validation auc = 0.648803
Epoch 1730
Validation auc = 0.640817
Epoch 1731
Loss = 2.9421e-03, PNorm = 131.9019, GNorm = 0.0449, lr_0 = 9.1411e-04
Validation auc = 0.638881
Epoch 1732
Validation auc = 0.641171
Epoch 1733
Validation auc = 0.645641
Epoch 1734
Validation auc = 0.647659
Epoch 1735
Loss = 6.1248e-02, PNorm = 132.0344, GNorm = 0.9065, lr_0 = 9.1390e-04
Loss = 1.5850e-02, PNorm = 132.0426, GNorm = 0.6850, lr_0 = 9.1389e-04
Validation auc = 0.642861
Epoch 1736
Validation auc = 0.635937
Epoch 1737
Validation auc = 0.631631
Epoch 1738
Validation auc = 0.628142
Epoch 1739
Validation auc = 0.629123
Epoch 1740
Loss = 2.3800e-03, PNorm = 132.1232, GNorm = 0.0471, lr_0 = 9.1366e-04
Loss = 4.3854e-01, PNorm = 132.1286, GNorm = 4.7659, lr_0 = 9.1364e-04
Validation auc = 0.633048
Epoch 1741
Validation auc = 0.636046
Epoch 1742
Validation auc = 0.637955
Epoch 1743
Validation auc = 0.648040
Epoch 1744
Validation auc = 0.646514
Epoch 1745
Loss = 1.4584e-02, PNorm = 132.3102, GNorm = 0.8600, lr_0 = 9.1343e-04
Validation auc = 0.655127
Epoch 1746
Validation auc = 0.658780
Epoch 1747
Validation auc = 0.660034
Epoch 1748
Validation auc = 0.656763
Epoch 1749
Loss = 1.2244e-01, PNorm = 132.4850, GNorm = 5.4274, lr_0 = 9.1320e-04
Validation auc = 0.650930
Epoch 1750
Validation auc = 0.631849
Epoch 1751
Validation auc = 0.621545
Epoch 1752
Validation auc = 0.623889
Epoch 1753
Validation auc = 0.631194
Epoch 1754
Loss = 5.9924e-02, PNorm = 132.7195, GNorm = 0.5678, lr_0 = 9.1298e-04
Loss = 1.0978e-03, PNorm = 132.7335, GNorm = 0.0423, lr_0 = 9.1296e-04
Validation auc = 0.636646
Epoch 1755
Validation auc = 0.640135
Epoch 1756
Validation auc = 0.642098
Epoch 1757
Validation auc = 0.633757
Epoch 1758
Validation auc = 0.619037
Epoch 1759
Loss = 1.0625e-01, PNorm = 132.8770, GNorm = 2.2465, lr_0 = 9.1275e-04
Validation auc = 0.635828
Epoch 1760
Validation auc = 0.652892
Epoch 1761
Validation auc = 0.658235
Epoch 1762
Validation auc = 0.664232
Epoch 1763
Validation auc = 0.670392
Epoch 1764
Loss = 1.1898e-01, PNorm = 133.2358, GNorm = 0.9328, lr_0 = 9.1251e-04
Validation auc = 0.672573
Epoch 1765
Validation auc = 0.657989
Epoch 1766
Validation auc = 0.641171
Epoch 1767
Validation auc = 0.656763
Epoch 1768
Loss = 8.6910e-03, PNorm = 133.4724, GNorm = 0.1883, lr_0 = 9.1230e-04
Loss = 6.1010e-03, PNorm = 133.4934, GNorm = 0.5696, lr_0 = 9.1228e-04
Validation auc = 0.665813
Epoch 1769
Validation auc = 0.663904
Epoch 1770
Validation auc = 0.640898
Epoch 1771
Validation auc = 0.640244
Epoch 1772
Validation auc = 0.639590
Epoch 1773
Loss = 9.6000e-02, PNorm = 133.8070, GNorm = 1.5848, lr_0 = 9.1206e-04
Loss = 1.7985e-04, PNorm = 133.8268, GNorm = 0.0060, lr_0 = 9.1204e-04
Validation auc = 0.641880
Epoch 1774
Validation auc = 0.641335
Epoch 1775
Validation auc = 0.642752
Epoch 1776
Validation auc = 0.644606
Epoch 1777
Validation auc = 0.634629
Epoch 1778
Loss = 1.2180e-01, PNorm = 134.0086, GNorm = 0.9815, lr_0 = 9.1183e-04
Validation auc = 0.629777
Epoch 1779
Validation auc = 0.639590
Epoch 1780
Validation auc = 0.646132
Epoch 1781
Validation auc = 0.648313
Epoch 1782
Validation auc = 0.648749
Epoch 1783
Loss = 3.0082e-02, PNorm = 134.2547, GNorm = 0.7890, lr_0 = 9.1159e-04
Validation auc = 0.641771
Epoch 1784
Validation auc = 0.636046
Epoch 1785
Validation auc = 0.641444
Epoch 1786
Validation auc = 0.645478
Epoch 1787
Loss = 1.5534e-02, PNorm = 134.4306, GNorm = 0.6002, lr_0 = 9.1138e-04
Loss = 7.0584e-03, PNorm = 134.4421, GNorm = 0.1743, lr_0 = 9.1136e-04
Validation auc = 0.648476
Epoch 1788
Validation auc = 0.642534
Epoch 1789
Validation auc = 0.639045
Epoch 1790
Validation auc = 0.632339
Epoch 1791
Validation auc = 0.628905
Epoch 1792
Loss = 2.9152e-03, PNorm = 134.5410, GNorm = 0.0552, lr_0 = 9.1115e-04
Validation auc = 0.625525
Epoch 1793
Validation auc = 0.621927
Epoch 1794
Validation auc = 0.619201
Epoch 1795
Validation auc = 0.617293
Epoch 1796
Validation auc = 0.615766
Epoch 1797
Loss = 1.9574e-02, PNorm = 134.5903, GNorm = 0.6558, lr_0 = 9.1091e-04
Validation auc = 0.615766
Epoch 1798
Validation auc = 0.606008
Epoch 1799
Validation auc = 0.568718
Epoch 1800
Validation auc = 0.549092
Epoch 1801
Loss = 1.0341e-02, PNorm = 134.7828, GNorm = 0.2871, lr_0 = 9.1070e-04
Loss = 3.5168e-03, PNorm = 134.8051, GNorm = 0.1102, lr_0 = 9.1068e-04
Validation auc = 0.541733
Epoch 1802
Validation auc = 0.551273
Epoch 1803
Validation auc = 0.565883
Epoch 1804
Validation auc = 0.585073
Epoch 1805
Validation auc = 0.588126
Epoch 1806
Loss = 1.4797e-02, PNorm = 135.0837, GNorm = 0.2159, lr_0 = 9.1046e-04
Loss = 1.1806e-04, PNorm = 135.1025, GNorm = 0.0039, lr_0 = 9.1044e-04
Validation auc = 0.591016
Epoch 1807
Validation auc = 0.594287
Epoch 1808
Validation auc = 0.597776
Epoch 1809
Validation auc = 0.600665
Epoch 1810
Validation auc = 0.603554
Epoch 1811
Loss = 3.5869e-03, PNorm = 135.2601, GNorm = 0.0860, lr_0 = 9.1023e-04
Validation auc = 0.606389
Epoch 1812
Validation auc = 0.609933
Epoch 1813
Validation auc = 0.612986
Epoch 1814
Validation auc = 0.614076
Epoch 1815
Validation auc = 0.613367
Epoch 1816
Loss = 3.3673e-03, PNorm = 135.3835, GNorm = 0.0561, lr_0 = 9.0999e-04
Validation auc = 0.613040
Epoch 1817
Validation auc = 0.614294
Epoch 1818
Validation auc = 0.614022
Epoch 1819
Validation auc = 0.613967
Epoch 1820
Loss = 5.8988e-03, PNorm = 135.4431, GNorm = 0.2729, lr_0 = 9.0978e-04
Loss = 4.7828e-01, PNorm = 135.4462, GNorm = 4.1385, lr_0 = 9.0976e-04
Validation auc = 0.613422
Epoch 1821
Validation auc = 0.613858
Epoch 1822
Validation auc = 0.612931
Epoch 1823
Validation auc = 0.611078
Epoch 1824
Validation auc = 0.607480
Epoch 1825
Loss = 2.9447e-02, PNorm = 135.5890, GNorm = 0.5053, lr_0 = 9.0955e-04
Validation auc = 0.604045
Epoch 1826
Validation auc = 0.601919
Epoch 1827
Validation auc = 0.598157
Epoch 1828
Validation auc = 0.594341
Epoch 1829
Validation auc = 0.592488
Epoch 1830
Loss = 5.0712e-04, PNorm = 135.7250, GNorm = 0.0088, lr_0 = 9.0931e-04
Validation auc = 0.589980
Epoch 1831
Validation auc = 0.587145
Epoch 1832
Validation auc = 0.584419
Epoch 1833
Validation auc = 0.584583
Epoch 1834
Loss = 2.0311e-03, PNorm = 135.7753, GNorm = 0.0647, lr_0 = 9.0910e-04
Loss = 1.5385e-03, PNorm = 135.7777, GNorm = 0.0776, lr_0 = 9.0909e-04
Validation auc = 0.582784
Epoch 1835
Validation auc = 0.591724
Epoch 1836
Validation auc = 0.594123
Epoch 1837
Validation auc = 0.596958
Epoch 1838
Validation auc = 0.598593
Epoch 1839
Loss = 2.3182e-03, PNorm = 135.8875, GNorm = 0.0427, lr_0 = 9.0886e-04
Loss = 1.7891e-01, PNorm = 135.8991, GNorm = 6.3447, lr_0 = 9.0884e-04
Validation auc = 0.597285
Epoch 1840
Validation auc = 0.595159
Epoch 1841
Validation auc = 0.609878
Epoch 1842
Validation auc = 0.614785
Epoch 1843
Validation auc = 0.618165
Epoch 1844
Loss = 3.1170e-03, PNorm = 136.2122, GNorm = 0.0743, lr_0 = 9.0863e-04
Validation auc = 0.623071
Epoch 1845
Validation auc = 0.615058
Epoch 1846
Validation auc = 0.609551
Epoch 1847
Validation auc = 0.608843
Epoch 1848
Validation auc = 0.608188
Epoch 1849
Loss = 1.4760e-01, PNorm = 136.5244, GNorm = 1.6176, lr_0 = 9.0839e-04
Validation auc = 0.620782
Epoch 1850
Validation auc = 0.630050
Epoch 1851
Validation auc = 0.634574
Epoch 1852
Validation auc = 0.640244
Epoch 1853
Loss = 3.1109e-02, PNorm = 136.8740, GNorm = 0.6511, lr_0 = 9.0818e-04
Loss = 4.9200e-02, PNorm = 136.8914, GNorm = 1.4013, lr_0 = 9.0817e-04
Validation auc = 0.642098
Epoch 1854
Validation auc = 0.642752
Epoch 1855
Validation auc = 0.647604
Epoch 1856
Validation auc = 0.651747
Epoch 1857
Validation auc = 0.657035
Epoch 1858
Loss = 7.5060e-03, PNorm = 137.0581, GNorm = 0.1442, lr_0 = 9.0794e-04
Validation auc = 0.665922
Epoch 1859
Validation auc = 0.673281
Epoch 1860
Validation auc = 0.677643
Epoch 1861
Validation auc = 0.677806
Epoch 1862
Validation auc = 0.670556
Epoch 1863
Loss = 5.1711e-03, PNorm = 137.1453, GNorm = 0.1046, lr_0 = 9.0772e-04
Validation auc = 0.657853
Epoch 1864
Validation auc = 0.635883
Epoch 1865
Validation auc = 0.622635
Epoch 1866
Validation auc = 0.618710
Epoch 1867
Loss = 2.3078e-03, PNorm = 137.3785, GNorm = 0.0280, lr_0 = 9.0751e-04
Loss = 3.5732e-04, PNorm = 137.4021, GNorm = 0.0156, lr_0 = 9.0749e-04
Validation auc = 0.626615
Epoch 1868
Validation auc = 0.603554
Epoch 1869
Validation auc = 0.596794
Epoch 1870
Validation auc = 0.590907
Epoch 1871
Validation auc = 0.590416
Epoch 1872
Loss = 2.9565e-03, PNorm = 137.6640, GNorm = 0.0980, lr_0 = 9.0727e-04
Loss = 1.1194e-03, PNorm = 137.6780, GNorm = 0.0556, lr_0 = 9.0725e-04
Validation auc = 0.591615
Epoch 1873
Validation auc = 0.598103
Epoch 1874
Validation auc = 0.605408
Epoch 1875
Validation auc = 0.610751
Epoch 1876
Validation auc = 0.612877
Epoch 1877
Loss = 9.5736e-04, PNorm = 137.8007, GNorm = 0.0138, lr_0 = 9.0704e-04
Validation auc = 0.615494
Epoch 1878
Validation auc = 0.613258
Epoch 1879
Validation auc = 0.612931
Epoch 1880
Validation auc = 0.614022
Epoch 1881
Validation auc = 0.610805
Epoch 1882
Loss = 3.8905e-04, PNorm = 137.8498, GNorm = 0.0093, lr_0 = 9.0680e-04
Validation auc = 0.607807
Epoch 1883
Validation auc = 0.568500
Epoch 1884
Validation auc = 0.580112
Epoch 1885
Validation auc = 0.598266
Epoch 1886
Loss = 1.8415e-02, PNorm = 137.9740, GNorm = 2.2249, lr_0 = 9.0659e-04
Loss = 5.8471e-04, PNorm = 137.9853, GNorm = 0.0236, lr_0 = 9.0657e-04
Validation auc = 0.605463
Epoch 1887
Validation auc = 0.617456
Epoch 1888
Validation auc = 0.624980
Epoch 1889
Validation auc = 0.630976
Epoch 1890
Validation auc = 0.633811
Epoch 1891
Loss = 2.2947e-03, PNorm = 138.1031, GNorm = 0.0439, lr_0 = 9.0635e-04
Validation auc = 0.633757
Epoch 1892
Validation auc = 0.634356
Epoch 1893
Validation auc = 0.637028
Epoch 1894
Validation auc = 0.637573
Epoch 1895
Validation auc = 0.638336
Epoch 1896
Loss = 2.4103e-03, PNorm = 138.1865, GNorm = 0.0502, lr_0 = 9.0612e-04
Validation auc = 0.639099
Epoch 1897
Validation auc = 0.639972
Epoch 1898
Validation auc = 0.641062
Epoch 1899
Validation auc = 0.642152
Epoch 1900
Loss = 6.6182e-02, PNorm = 138.2274, GNorm = 0.8399, lr_0 = 9.0592e-04
Loss = 4.9068e-04, PNorm = 138.2286, GNorm = 0.0155, lr_0 = 9.0590e-04
Validation auc = 0.640680
Epoch 1901
Validation auc = 0.638282
Epoch 1902
Validation auc = 0.637464
Epoch 1903
Validation auc = 0.637137
Epoch 1904
Validation auc = 0.637573
Epoch 1905
Loss = 2.0820e-03, PNorm = 138.2508, GNorm = 0.0475, lr_0 = 9.0567e-04
Loss = 3.4026e-04, PNorm = 138.2523, GNorm = 0.0117, lr_0 = 9.0566e-04
Validation auc = 0.635501
Epoch 1906
Validation auc = 0.632884
Epoch 1907
Validation auc = 0.630813
Epoch 1908
Validation auc = 0.619364
Epoch 1909
Validation auc = 0.612223
Epoch 1910
Loss = 1.3124e-03, PNorm = 138.2661, GNorm = 0.0275, lr_0 = 9.0545e-04
Validation auc = 0.609388
Epoch 1911
Validation auc = 0.608243
Epoch 1912
Validation auc = 0.609442
Epoch 1913
Validation auc = 0.609824
Epoch 1914
Validation auc = 0.609551
Epoch 1915
Loss = 2.2909e-04, PNorm = 138.3114, GNorm = 0.0089, lr_0 = 9.0521e-04
Validation auc = 0.609987
Epoch 1916
Validation auc = 0.609715
Epoch 1917
Validation auc = 0.609333
Epoch 1918
Validation auc = 0.618438
Epoch 1919
Loss = 3.2781e-04, PNorm = 138.3244, GNorm = 0.0055, lr_0 = 9.0500e-04
Loss = 3.1775e-04, PNorm = 138.3245, GNorm = 0.0182, lr_0 = 9.0498e-04
Validation auc = 0.621490
Epoch 1920
Validation auc = 0.622145
Epoch 1921
Validation auc = 0.623780
Epoch 1922
Validation auc = 0.624325
Epoch 1923
Validation auc = 0.624925
Epoch 1924
Loss = 6.4795e-04, PNorm = 138.3684, GNorm = 0.0040, lr_0 = 9.0476e-04
Validation auc = 0.625797
Epoch 1925
Validation auc = 0.625906
Epoch 1926
Validation auc = 0.625743
Epoch 1927
Validation auc = 0.625634
Epoch 1928
Validation auc = 0.625961
Epoch 1929
Loss = 1.5081e-04, PNorm = 138.4082, GNorm = 0.0029, lr_0 = 9.0454e-04
Validation auc = 0.625743
Epoch 1930
Validation auc = 0.624925
Epoch 1931
Validation auc = 0.624598
Epoch 1932
Validation auc = 0.624271
Epoch 1933
Loss = 2.2010e-04, PNorm = 138.4217, GNorm = 0.0046, lr_0 = 9.0431e-04
Validation auc = 0.624107
Epoch 1934
Validation auc = 0.624162
Epoch 1935
Validation auc = 0.623671
Epoch 1936
Validation auc = 0.623453
Epoch 1937
Validation auc = 0.622962
Epoch 1938
Loss = 1.5375e-04, PNorm = 138.4267, GNorm = 0.0033, lr_0 = 9.0409e-04
Loss = 4.1723e-06, PNorm = 138.4271, GNorm = 0.0003, lr_0 = 9.0407e-04
Validation auc = 0.622254
Epoch 1939
Validation auc = 0.621818
Epoch 1940
Validation auc = 0.621381
Epoch 1941
Validation auc = 0.621163
Epoch 1942
Validation auc = 0.621272
Epoch 1943
Loss = 1.4074e-04, PNorm = 138.4328, GNorm = 0.0028, lr_0 = 9.0386e-04
Validation auc = 0.621054
Epoch 1944
Validation auc = 0.620782
Epoch 1945
Validation auc = 0.620019
Epoch 1946
Validation auc = 0.619637
Epoch 1947
Validation auc = 0.619092
Epoch 1948
Loss = 1.7887e-04, PNorm = 138.4376, GNorm = 0.0049, lr_0 = 9.0362e-04
Validation auc = 0.619092
Epoch 1949
Validation auc = 0.619037
Epoch 1950
Validation auc = 0.618274
Epoch 1951
Validation auc = 0.617456
Epoch 1952
Loss = 1.5973e-04, PNorm = 138.4404, GNorm = 0.0048, lr_0 = 9.0341e-04
Loss = 6.1045e-05, PNorm = 138.4405, GNorm = 0.0021, lr_0 = 9.0340e-04
Validation auc = 0.616966
Epoch 1953
Validation auc = 0.616584
Epoch 1954
Validation auc = 0.616911
Epoch 1955
Validation auc = 0.617347
Epoch 1956
Validation auc = 0.617565
Epoch 1957
Loss = 1.2794e-04, PNorm = 138.4473, GNorm = 0.0024, lr_0 = 9.0317e-04
Loss = 7.3899e-05, PNorm = 138.4478, GNorm = 0.0034, lr_0 = 9.0316e-04
Validation auc = 0.617511
Epoch 1958
Validation auc = 0.620237
Epoch 1959
Validation auc = 0.620182
Epoch 1960
Validation auc = 0.618601
Epoch 1961
Validation auc = 0.619910
Epoch 1962
Loss = 1.0934e-04, PNorm = 138.5020, GNorm = 0.0027, lr_0 = 9.0295e-04
Validation auc = 0.643243
Epoch 1963
Validation auc = 0.649294
Epoch 1964
Validation auc = 0.622908
Epoch 1965
Validation auc = 0.610860
Epoch 1966
Loss = 4.0662e-01, PNorm = 138.7816, GNorm = 20.2707, lr_0 = 9.0273e-04
Validation auc = 0.626506
Epoch 1967
Validation auc = 0.646023
Epoch 1968
Validation auc = 0.653982
Epoch 1969
Validation auc = 0.656817
Epoch 1970
Validation auc = 0.648313
Epoch 1971
Loss = 4.4509e-02, PNorm = 139.3212, GNorm = 0.7754, lr_0 = 9.0250e-04
Loss = 2.1651e-03, PNorm = 139.3508, GNorm = 0.0783, lr_0 = 9.0249e-04
Validation auc = 0.636646
Epoch 1972
Validation auc = 0.633212
Epoch 1973
Validation auc = 0.628850
Epoch 1974
Validation auc = 0.626179
Epoch 1975
Validation auc = 0.621381
Epoch 1976
Loss = 1.9892e-02, PNorm = 139.6318, GNorm = 1.0426, lr_0 = 9.0228e-04
Validation auc = 0.617620
Epoch 1977
Validation auc = 0.610151
Epoch 1978
Validation auc = 0.602519
Epoch 1979
Validation auc = 0.596467
Epoch 1980
Validation auc = 0.591724
Epoch 1981
Loss = 4.5797e-04, PNorm = 139.7806, GNorm = 0.0100, lr_0 = 9.0204e-04
Validation auc = 0.588726
Epoch 1982
Validation auc = 0.585019
Epoch 1983
Validation auc = 0.582947
Epoch 1984
Validation auc = 0.587036
Epoch 1985
Loss = 7.2178e-02, PNorm = 139.8454, GNorm = 3.3260, lr_0 = 9.0183e-04
Loss = 1.3057e-03, PNorm = 139.8476, GNorm = 0.0281, lr_0 = 9.0181e-04
Validation auc = 0.578967
Epoch 1986
Validation auc = 0.575097
Epoch 1987
Validation auc = 0.584365
Epoch 1988
Validation auc = 0.586109
Epoch 1989
Validation auc = 0.588344
Epoch 1990
Loss = 3.0824e-03, PNorm = 139.9394, GNorm = 0.0908, lr_0 = 9.0159e-04
Loss = 1.5437e-03, PNorm = 139.9471, GNorm = 0.1279, lr_0 = 9.0157e-04
Validation auc = 0.587799
Epoch 1991
Validation auc = 0.587581
Epoch 1992
Validation auc = 0.591234
Epoch 1993
Validation auc = 0.603827
Epoch 1994
Validation auc = 0.603500
Epoch 1995
Loss = 2.6295e-03, PNorm = 140.0266, GNorm = 0.1319, lr_0 = 9.0137e-04
Validation auc = 0.598975
Epoch 1996
Validation auc = 0.594232
Epoch 1997
Validation auc = 0.592651
Epoch 1998
Validation auc = 0.594995
Epoch 1999
Loss = 5.2095e-03, PNorm = 140.1025, GNorm = 0.0000, lr_0 = 9.0114e-04
Validation auc = 0.601810
Model 0 best validation auc = 0.734940 on epoch 496
Loading pretrained parameter "encoder.encoder.0.cached_zero_vector".
Loading pretrained parameter "encoder.encoder.0.W_i.weight".
Loading pretrained parameter "encoder.encoder.0.W_h.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.bias".
Loading pretrained parameter "ffn.1.weight".
Loading pretrained parameter "ffn.1.bias".
Moving model to cuda
Model 0 test auc = 0.689636
Ensemble test auc = 0.689636
Fold 9
Splitting data with seed 9
Class sizes
sars_cov_two_active 0: 98.39%, 1: 1.61%
Total size = 3,294 | train size = 3,294 | val size = 1,096 | test size = 1,086
With class_balance, effective train size = 106
Building model 0
MoleculeModel(
  (sigmoid): Sigmoid()
  (encoder): MPN(
    (encoder): ModuleList(
      (0): MPNEncoder(
        (dropout_layer): Dropout(p=0.05, inplace=False)
        (act_func): ReLU()
        (W_i): Linear(in_features=147, out_features=2100, bias=False)
        (W_h): Linear(in_features=2100, out_features=2100, bias=False)
        (W_o): Linear(in_features=2233, out_features=2100, bias=True)
      )
    )
  )
  (ffn): Sequential(
    (0): Dropout(p=0.05, inplace=False)
    (1): Linear(in_features=2328, out_features=1, bias=True)
  )
)
Number of parameters = 9,412,429
Moving model to cuda
Epoch 0
Validation auc = 0.612332
Epoch 1
Validation auc = 0.535136
Epoch 2
Validation auc = 0.628142
Epoch 3
Validation auc = 0.628032
Epoch 4
Loss = 7.0498e-01, PNorm = 67.4096, GNorm = 1.3754, lr_0 = 2.0385e-04
Loss = 6.8351e-01, PNorm = 67.4117, GNorm = 2.3397, lr_0 = 2.1077e-04
Validation auc = 0.608952
Epoch 5
Validation auc = 0.664341
Epoch 6
Validation auc = 0.656163
Epoch 7
Validation auc = 0.626070
Epoch 8
Validation auc = 0.654691
Epoch 9
Loss = 7.1117e-01, PNorm = 67.4504, GNorm = 1.6375, lr_0 = 3.0077e-04
Validation auc = 0.623726
Epoch 10
Validation auc = 0.554108
Epoch 11
Validation auc = 0.669792
Epoch 12
Validation auc = 0.622308
Epoch 13
Validation auc = 0.634465
Epoch 14
Loss = 6.9253e-01, PNorm = 67.5114, GNorm = 0.8341, lr_0 = 4.0462e-04
Validation auc = 0.646841
Epoch 15
Validation auc = 0.641335
Epoch 16
Validation auc = 0.648912
Epoch 17
Validation auc = 0.649621
Epoch 18
Loss = 6.5163e-01, PNorm = 67.5935, GNorm = 1.0524, lr_0 = 4.9462e-04
Loss = 5.0962e-01, PNorm = 67.6005, GNorm = 3.0741, lr_0 = 5.0154e-04
Validation auc = 0.641716
Epoch 19
Validation auc = 0.640135
Epoch 20
Validation auc = 0.625416
Epoch 21
Validation auc = 0.641934
Epoch 22
Validation auc = 0.658289
Epoch 23
Loss = 6.7526e-01, PNorm = 67.7151, GNorm = 1.6861, lr_0 = 5.9846e-04
Loss = 8.8520e-01, PNorm = 67.7194, GNorm = 3.3639, lr_0 = 6.0538e-04
Validation auc = 0.649512
Epoch 24
Validation auc = 0.612822
Epoch 25
Validation auc = 0.587581
Epoch 26
Validation auc = 0.591179
Epoch 27
Validation auc = 0.606171
Epoch 28
Loss = 6.7214e-01, PNorm = 67.8609, GNorm = 1.4354, lr_0 = 6.9538e-04
Validation auc = 0.632121
Epoch 29
Validation auc = 0.638881
Epoch 30
Validation auc = 0.642370
Epoch 31
Validation auc = 0.626561
Epoch 32
Validation auc = 0.637682
Epoch 33
Loss = 6.3787e-01, PNorm = 68.1606, GNorm = 1.0924, lr_0 = 7.9923e-04
Validation auc = 0.639481
Epoch 34
Validation auc = 0.641062
Epoch 35
Validation auc = 0.628959
Epoch 36
Validation auc = 0.633975
Epoch 37
Loss = 6.0280e-01, PNorm = 68.4813, GNorm = 0.9929, lr_0 = 8.8923e-04
Loss = 5.4730e-01, PNorm = 68.5127, GNorm = 2.6531, lr_0 = 8.9615e-04
Validation auc = 0.642098
Epoch 38
Validation auc = 0.649458
Epoch 39
Validation auc = 0.626124
Epoch 40
Validation auc = 0.616693
Epoch 41
Validation auc = 0.619310
Epoch 42
Loss = 6.3706e-01, PNorm = 68.8529, GNorm = 1.2779, lr_0 = 9.8615e-04
Validation auc = 0.630050
Epoch 43
Validation auc = 0.588399
Epoch 44
Validation auc = 0.576078
Epoch 45
Validation auc = 0.579622
Epoch 46
Validation auc = 0.595650
Epoch 47
Loss = 5.3324e-01, PNorm = 69.3448, GNorm = 0.7321, lr_0 = 9.9977e-04
Validation auc = 0.605681
Epoch 48
Validation auc = 0.618329
Epoch 49
Validation auc = 0.626070
Epoch 50
Validation auc = 0.566483
Epoch 51
Loss = 5.5494e-01, PNorm = 69.8054, GNorm = 1.1332, lr_0 = 9.9954e-04
Loss = 5.4031e-01, PNorm = 69.8486, GNorm = 1.8583, lr_0 = 9.9952e-04
Validation auc = 0.549692
Epoch 52
Validation auc = 0.591506
Epoch 53
Validation auc = 0.589435
Epoch 54
Validation auc = 0.611078
Epoch 55
Validation auc = 0.642316
Epoch 56
Loss = 5.8230e-01, PNorm = 70.4605, GNorm = 0.9583, lr_0 = 9.9927e-04
Loss = 4.5835e-01, PNorm = 70.4998, GNorm = 1.4879, lr_0 = 9.9926e-04
Validation auc = 0.634520
Epoch 57
Validation auc = 0.617565
Epoch 58
Validation auc = 0.602900
Epoch 59
Validation auc = 0.588617
Epoch 60
Validation auc = 0.621763
Epoch 61
Loss = 9.8369e-01, PNorm = 71.0818, GNorm = 7.7274, lr_0 = 9.9903e-04
Validation auc = 0.661124
Epoch 62
Validation auc = 0.635937
Epoch 63
Validation auc = 0.631903
Epoch 64
Validation auc = 0.640190
Epoch 65
Validation auc = 0.645151
Epoch 66
Loss = 5.8382e-01, PNorm = 71.8906, GNorm = 1.2516, lr_0 = 9.9876e-04
Validation auc = 0.647113
Epoch 67
Validation auc = 0.643352
Epoch 68
Validation auc = 0.661506
Epoch 69
Validation auc = 0.632612
Epoch 70
Loss = 4.5536e-01, PNorm = 72.4776, GNorm = 1.0865, lr_0 = 9.9853e-04
Loss = 4.8477e-01, PNorm = 72.5317, GNorm = 2.5757, lr_0 = 9.9851e-04
Validation auc = 0.645205
Epoch 71
Validation auc = 0.638336
Epoch 72
Validation auc = 0.642697
Epoch 73
Validation auc = 0.630704
Epoch 74
Validation auc = 0.609115
Epoch 75
Loss = 4.8631e-01, PNorm = 73.1523, GNorm = 0.9785, lr_0 = 9.9828e-04
Validation auc = 0.606825
Epoch 76
Validation auc = 0.605735
Epoch 77
Validation auc = 0.601156
Epoch 78
Validation auc = 0.590798
Epoch 79
Validation auc = 0.644660
Epoch 80
Loss = 6.2452e-01, PNorm = 73.8990, GNorm = 6.2908, lr_0 = 9.9802e-04
Validation auc = 0.638554
Epoch 81
Validation auc = 0.595595
Epoch 82
Validation auc = 0.617184
Epoch 83
Validation auc = 0.624980
Epoch 84
Loss = 3.7283e-01, PNorm = 74.6258, GNorm = 1.6032, lr_0 = 9.9779e-04
Loss = 4.6989e-01, PNorm = 74.6830, GNorm = 2.2685, lr_0 = 9.9777e-04
Validation auc = 0.622308
Epoch 85
Validation auc = 0.618219
Epoch 86
Validation auc = 0.630431
Epoch 87
Validation auc = 0.621381
Epoch 88
Validation auc = 0.640898
Epoch 89
Loss = 3.3293e-01, PNorm = 75.4327, GNorm = 1.5488, lr_0 = 9.9752e-04
Loss = 2.4781e-01, PNorm = 75.4828, GNorm = 2.4100, lr_0 = 9.9750e-04
Validation auc = 0.641117
Epoch 90
Validation auc = 0.630922
Epoch 91
Validation auc = 0.620891
Epoch 92
Validation auc = 0.626779
Epoch 93
Validation auc = 0.631358
Epoch 94
Loss = 1.0662e-01, PNorm = 76.1138, GNorm = 0.9278, lr_0 = 9.9727e-04
Validation auc = 0.646241
Epoch 95
Validation auc = 0.661179
Epoch 96
Validation auc = 0.658507
Epoch 97
Validation auc = 0.651475
Epoch 98
Validation auc = 0.642752
Epoch 99
Loss = 1.5152e-01, PNorm = 76.8033, GNorm = 0.8711, lr_0 = 9.9701e-04
Validation auc = 0.639863
Epoch 100
Validation auc = 0.658180
Epoch 101
Validation auc = 0.680696
Epoch 102
Validation auc = 0.689255
Epoch 103
Loss = 2.3219e-01, PNorm = 77.3975, GNorm = 1.2174, lr_0 = 9.9678e-04
Loss = 7.7260e-02, PNorm = 77.4371, GNorm = 2.2017, lr_0 = 9.9676e-04
Validation auc = 0.629014
Epoch 104
Validation auc = 0.543423
Epoch 105
Validation auc = 0.626561
Epoch 106
Validation auc = 0.649349
Epoch 107
Validation auc = 0.647113
Epoch 108
Loss = 1.9003e-01, PNorm = 77.9837, GNorm = 2.5056, lr_0 = 9.9651e-04
Validation auc = 0.630050
Epoch 109
Validation auc = 0.639372
Epoch 110
Validation auc = 0.663414
Epoch 111
Validation auc = 0.665158
Epoch 112
Validation auc = 0.669465
Epoch 113
Loss = 1.4855e-01, PNorm = 78.5451, GNorm = 2.3652, lr_0 = 9.9627e-04
Validation auc = 0.664613
Epoch 114
Validation auc = 0.680914
Epoch 115
Validation auc = 0.665976
Epoch 116
Validation auc = 0.654855
Epoch 117
Loss = 1.4061e-01, PNorm = 78.9654, GNorm = 0.6087, lr_0 = 9.9604e-04
Loss = 7.4301e-03, PNorm = 78.9929, GNorm = 0.1353, lr_0 = 9.9602e-04
Validation auc = 0.649239
Epoch 118
Validation auc = 0.645423
Epoch 119
Validation auc = 0.650766
Epoch 120
Validation auc = 0.657472
Epoch 121
Validation auc = 0.663359
Epoch 122
Loss = 5.1097e-02, PNorm = 79.3917, GNorm = 0.2712, lr_0 = 9.9577e-04
Loss = 3.7695e-02, PNorm = 79.4191, GNorm = 1.4097, lr_0 = 9.9575e-04
Validation auc = 0.682822
Epoch 123
Validation auc = 0.686474
Epoch 124
Validation auc = 0.681840
Epoch 125
Validation auc = 0.658017
Epoch 126
Validation auc = 0.649730
Epoch 127
Loss = 1.6958e-01, PNorm = 79.7790, GNorm = 1.3617, lr_0 = 9.9552e-04
Validation auc = 0.663632
Epoch 128
Validation auc = 0.630377
Epoch 129
Validation auc = 0.624761
Epoch 130
Validation auc = 0.633866
Epoch 131
Validation auc = 0.646132
Epoch 132
Loss = 9.7902e-02, PNorm = 80.4481, GNorm = 0.6177, lr_0 = 9.9526e-04
Validation auc = 0.626124
Epoch 133
Validation auc = 0.581366
Epoch 134
Validation auc = 0.598430
Epoch 135
Validation auc = 0.632721
Epoch 136
Loss = 2.1850e-01, PNorm = 81.0312, GNorm = 0.8720, lr_0 = 9.9503e-04
Loss = 2.8851e-02, PNorm = 81.0860, GNorm = 0.4244, lr_0 = 9.9501e-04
Validation auc = 0.641117
Epoch 137
Validation auc = 0.644497
Epoch 138
Validation auc = 0.628959
Epoch 139
Validation auc = 0.611405
Epoch 140
Validation auc = 0.593632
Epoch 141
Loss = 1.3315e-01, PNorm = 81.7318, GNorm = 0.6815, lr_0 = 9.9477e-04
Validation auc = 0.578640
Epoch 142
Validation auc = 0.589544
Epoch 143
Validation auc = 0.615603
Epoch 144
Validation auc = 0.631194
Epoch 145
Validation auc = 0.641934
Epoch 146
Loss = 2.0461e-01, PNorm = 82.2118, GNorm = 1.1855, lr_0 = 9.9452e-04
Validation auc = 0.630486
Epoch 147
Validation auc = 0.616857
Epoch 148
Validation auc = 0.601319
Epoch 149
Validation auc = 0.600883
Epoch 150
Loss = 1.2739e-01, PNorm = 82.6172, GNorm = 1.6135, lr_0 = 9.9429e-04
Loss = 1.1273e-01, PNorm = 82.6436, GNorm = 3.5018, lr_0 = 9.9427e-04
Validation auc = 0.603227
Epoch 151
Validation auc = 0.590416
Epoch 152
Validation auc = 0.585128
Epoch 153
Validation auc = 0.577605
Epoch 154
Validation auc = 0.568991
Epoch 155
Loss = 9.0698e-02, PNorm = 83.1455, GNorm = 0.8807, lr_0 = 9.9403e-04
Loss = 2.0673e-02, PNorm = 83.1800, GNorm = 0.4281, lr_0 = 9.9401e-04
Validation auc = 0.570299
Epoch 156
Validation auc = 0.560159
Epoch 157
Validation auc = 0.569209
Epoch 158
Validation auc = 0.595377
Epoch 159
Validation auc = 0.613586
Epoch 160
Loss = 8.6757e-02, PNorm = 83.5283, GNorm = 1.1431, lr_0 = 9.9378e-04
Validation auc = 0.624380
Epoch 161
Validation auc = 0.626124
Epoch 162
Validation auc = 0.626561
Epoch 163
Validation auc = 0.613040
Epoch 164
Validation auc = 0.573897
Epoch 165
Loss = 1.4038e-01, PNorm = 84.0489, GNorm = 1.5723, lr_0 = 9.9351e-04
Validation auc = 0.574770
Epoch 166
Validation auc = 0.608952
Epoch 167
Validation auc = 0.632230
Epoch 168
Validation auc = 0.646023
Epoch 169
Loss = 9.8532e-02, PNorm = 84.5598, GNorm = 0.8758, lr_0 = 9.9329e-04
Loss = 1.3727e-02, PNorm = 84.5934, GNorm = 0.3438, lr_0 = 9.9327e-04
Validation auc = 0.653274
Epoch 170
Validation auc = 0.659652
Epoch 171
Validation auc = 0.661179
Epoch 172
Validation auc = 0.649130
Epoch 173
Validation auc = 0.634738
Epoch 174
Loss = 5.8533e-02, PNorm = 85.0029, GNorm = 0.8285, lr_0 = 9.9302e-04
Validation auc = 0.614185
Epoch 175
Validation auc = 0.609170
Epoch 176
Validation auc = 0.602628
Epoch 177
Validation auc = 0.615058
Epoch 178
Validation auc = 0.625470
Epoch 179
Loss = 1.5827e-01, PNorm = 85.3614, GNorm = 1.1197, lr_0 = 9.9277e-04
Validation auc = 0.629832
Epoch 180
Validation auc = 0.637627
Epoch 181
Validation auc = 0.641117
Epoch 182
Validation auc = 0.641062
Epoch 183
Loss = 8.3911e-02, PNorm = 85.6403, GNorm = 2.6602, lr_0 = 9.9253e-04
Validation auc = 0.643624
Epoch 184
Validation auc = 0.641226
Epoch 185
Validation auc = 0.640680
Epoch 186
Validation auc = 0.635283
Epoch 187
Validation auc = 0.647222
Epoch 188
Loss = 3.9155e-02, PNorm = 85.8874, GNorm = 0.4200, lr_0 = 9.9228e-04
Loss = 1.2500e-01, PNorm = 85.9075, GNorm = 2.9066, lr_0 = 9.9226e-04
Validation auc = 0.674699
Epoch 189
Validation auc = 0.672082
Epoch 190
Validation auc = 0.671264
Epoch 191
Validation auc = 0.671046
Epoch 192
Validation auc = 0.661560
Epoch 193
Loss = 4.4441e-02, PNorm = 86.2378, GNorm = 0.7236, lr_0 = 9.9204e-04
Validation auc = 0.658725
Epoch 194
Validation auc = 0.644933
Epoch 195
Validation auc = 0.635283
Epoch 196
Validation auc = 0.631140
Epoch 197
Validation auc = 0.630104
Epoch 198
Loss = 1.0606e-02, PNorm = 86.5392, GNorm = 0.1690, lr_0 = 9.9177e-04
Validation auc = 0.627324
Epoch 199
Validation auc = 0.627378
Epoch 200
Validation auc = 0.633975
Epoch 201
Validation auc = 0.635665
Epoch 202
Loss = 2.3148e-02, PNorm = 86.7075, GNorm = 1.3642, lr_0 = 9.9154e-04
Loss = 3.4701e-02, PNorm = 86.7234, GNorm = 1.1676, lr_0 = 9.9153e-04
Validation auc = 0.632067
Epoch 203
Validation auc = 0.626615
Epoch 204
Validation auc = 0.629341
Epoch 205
Validation auc = 0.643570
Epoch 206
Validation auc = 0.648258
Epoch 207
Loss = 3.9801e-02, PNorm = 86.9290, GNorm = 0.5145, lr_0 = 9.9128e-04
Loss = 1.5294e-03, PNorm = 86.9421, GNorm = 0.0397, lr_0 = 9.9126e-04
Validation auc = 0.648585
Epoch 208
Validation auc = 0.650657
Epoch 209
Validation auc = 0.659107
Epoch 210
Validation auc = 0.674263
Epoch 211
Validation auc = 0.679278
Epoch 212
Loss = 2.7029e-02, PNorm = 87.1107, GNorm = 0.6218, lr_0 = 9.9103e-04
Validation auc = 0.682495
Epoch 213
Validation auc = 0.682549
Epoch 214
Validation auc = 0.683258
Epoch 215
Validation auc = 0.683367
Epoch 216
Loss = 1.9272e-02, PNorm = 87.2780, GNorm = 0.1599, lr_0 = 9.9079e-04
Validation auc = 0.683858
Epoch 217
Validation auc = 0.682059
Epoch 218
Validation auc = 0.680150
Epoch 219
Validation auc = 0.675462
Epoch 220
Validation auc = 0.673881
Epoch 221
Loss = 6.2398e-03, PNorm = 87.3821, GNorm = 0.0423, lr_0 = 9.9054e-04
Loss = 5.6142e-04, PNorm = 87.3874, GNorm = 0.0180, lr_0 = 9.9052e-04
Validation auc = 0.672573
Epoch 222
Validation auc = 0.668538
Epoch 223
Validation auc = 0.665049
Epoch 224
Validation auc = 0.665213
Epoch 225
Validation auc = 0.666303
Epoch 226
Loss = 1.7822e-02, PNorm = 87.4570, GNorm = 0.4495, lr_0 = 9.9030e-04
Validation auc = 0.665431
Epoch 227
Validation auc = 0.662978
Epoch 228
Validation auc = 0.647113
Epoch 229
Validation auc = 0.644660
Epoch 230
Validation auc = 0.652129
Epoch 231
Loss = 1.4146e-02, PNorm = 87.5152, GNorm = 0.6065, lr_0 = 9.9003e-04
Validation auc = 0.659816
Epoch 232
Validation auc = 0.659489
Epoch 233
Validation auc = 0.655509
Epoch 234
Validation auc = 0.649676
Epoch 235
Loss = 5.8267e-03, PNorm = 87.5976, GNorm = 0.2181, lr_0 = 9.8980e-04
Loss = 1.3269e-02, PNorm = 87.6048, GNorm = 0.6472, lr_0 = 9.8979e-04
Validation auc = 0.640190
Epoch 236
Validation auc = 0.640408
Epoch 237
Validation auc = 0.640571
Epoch 238
Validation auc = 0.645805
Epoch 239
Validation auc = 0.655345
Epoch 240
Loss = 2.3100e-02, PNorm = 87.7158, GNorm = 0.5049, lr_0 = 9.8954e-04
Loss = 4.4889e-02, PNorm = 87.7292, GNorm = 1.8249, lr_0 = 9.8952e-04
Validation auc = 0.670010
Epoch 241
Validation auc = 0.688546
Epoch 242
Validation auc = 0.704083
Epoch 243
Validation auc = 0.711170
Epoch 244
Validation auc = 0.711552
Epoch 245
Loss = 1.1834e-01, PNorm = 87.9181, GNorm = 1.4436, lr_0 = 9.8930e-04
Validation auc = 0.697432
Epoch 246
Validation auc = 0.677588
Epoch 247
Validation auc = 0.667285
Epoch 248
Validation auc = 0.664123
Epoch 249
Loss = 1.6019e-02, PNorm = 88.1662, GNorm = 2.1678, lr_0 = 9.8905e-04
Validation auc = 0.661669
Epoch 250
Validation auc = 0.674808
Epoch 251
Validation auc = 0.666412
Epoch 252
Validation auc = 0.725672
Epoch 253
Validation auc = 0.693998
Epoch 254
Loss = 3.5446e-02, PNorm = 88.7082, GNorm = 0.8467, lr_0 = 9.8880e-04
Loss = 8.1088e-02, PNorm = 88.7640, GNorm = 2.7221, lr_0 = 9.8879e-04
Validation auc = 0.660852
Epoch 255
Validation auc = 0.625198
Epoch 256
Validation auc = 0.607425
Epoch 257
Validation auc = 0.612168
Epoch 258
Validation auc = 0.646895
Epoch 259
Loss = 6.6650e-02, PNorm = 89.5910, GNorm = 1.5499, lr_0 = 9.8856e-04
Validation auc = 0.669465
Epoch 260
Validation auc = 0.695306
Epoch 261
Validation auc = 0.705937
Epoch 262
Validation auc = 0.707245
Epoch 263
Validation auc = 0.693889
Epoch 264
Loss = 8.4398e-02, PNorm = 90.7077, GNorm = 0.7112, lr_0 = 9.8830e-04
Validation auc = 0.677370
Epoch 265
Validation auc = 0.672682
Epoch 266
Validation auc = 0.672682
Epoch 267
Validation auc = 0.675789
Epoch 268
Loss = 9.9020e-02, PNorm = 91.3332, GNorm = 1.6438, lr_0 = 9.8807e-04
Loss = 8.8223e-02, PNorm = 91.3705, GNorm = 2.4988, lr_0 = 9.8805e-04
Validation auc = 0.684566
Epoch 269
Validation auc = 0.687238
Epoch 270
Validation auc = 0.693234
Epoch 271
Validation auc = 0.706973
Epoch 272
Validation auc = 0.702884
Epoch 273
Loss = 4.0575e-02, PNorm = 91.8146, GNorm = 0.7836, lr_0 = 9.8781e-04
Loss = 1.6135e-02, PNorm = 91.8460, GNorm = 0.4743, lr_0 = 9.8779e-04
Validation auc = 0.698577
Epoch 274
Validation auc = 0.696287
Epoch 275
Validation auc = 0.702230
Epoch 276
Validation auc = 0.694652
Epoch 277
Validation auc = 0.680369
Epoch 278
Loss = 4.9804e-02, PNorm = 92.2022, GNorm = 0.8720, lr_0 = 9.8756e-04
Validation auc = 0.669138
Epoch 279
Validation auc = 0.663250
Epoch 280
Validation auc = 0.662705
Epoch 281
Validation auc = 0.659816
Epoch 282
Validation auc = 0.673445
Epoch 283
Loss = 3.0137e-02, PNorm = 92.4951, GNorm = 0.2997, lr_0 = 9.8730e-04
Validation auc = 0.684457
Epoch 284
Validation auc = 0.687892
Epoch 285
Validation auc = 0.681786
Epoch 286
Validation auc = 0.677425
Epoch 287
Loss = 3.2938e-02, PNorm = 92.6669, GNorm = 0.3431, lr_0 = 9.8707e-04
Loss = 3.2994e-01, PNorm = 92.6789, GNorm = 5.4954, lr_0 = 9.8705e-04
Validation auc = 0.677207
Epoch 288
Validation auc = 0.676661
Epoch 289
Validation auc = 0.668375
Epoch 290
Validation auc = 0.662705
Epoch 291
Validation auc = 0.664395
Epoch 292
Loss = 6.6310e-02, PNorm = 92.8688, GNorm = 1.5752, lr_0 = 9.8683e-04
Validation auc = 0.673172
Epoch 293
Validation auc = 0.678951
Epoch 294
Validation auc = 0.676334
Epoch 295
Validation auc = 0.668429
Epoch 296
Validation auc = 0.659216
Epoch 297
Loss = 5.9562e-02, PNorm = 93.0574, GNorm = 0.7647, lr_0 = 9.8656e-04
Validation auc = 0.658398
Epoch 298
Validation auc = 0.656218
Epoch 299
Validation auc = 0.647113
Epoch 300
Validation auc = 0.645532
Epoch 301
Loss = 1.7883e-01, PNorm = 93.2043, GNorm = 0.0441, lr_0 = 9.8634e-04
Loss = 2.4408e-02, PNorm = 93.2227, GNorm = 1.0108, lr_0 = 9.8632e-04
Validation auc = 0.639154
Epoch 302
Validation auc = 0.627705
Epoch 303
Validation auc = 0.608406
Epoch 304
Validation auc = 0.603664
Epoch 305
Validation auc = 0.596086
Epoch 306
Loss = 1.7524e-01, PNorm = 93.5228, GNorm = 1.4672, lr_0 = 9.8607e-04
Loss = 7.8456e-03, PNorm = 93.5464, GNorm = 0.1730, lr_0 = 9.8606e-04
Validation auc = 0.582729
Epoch 307
Validation auc = 0.579731
Epoch 308
Validation auc = 0.581966
Epoch 309
Validation auc = 0.585455
Epoch 310
Validation auc = 0.586382
Epoch 311
Loss = 5.9409e-02, PNorm = 93.8123, GNorm = 0.8196, lr_0 = 9.8583e-04
Validation auc = 0.590961
Epoch 312
Validation auc = 0.595377
Epoch 313
Validation auc = 0.596958
Epoch 314
Validation auc = 0.599738
Epoch 315
Validation auc = 0.605626
Epoch 316
Loss = 4.7626e-02, PNorm = 94.0154, GNorm = 0.4138, lr_0 = 9.8557e-04
Validation auc = 0.622962
Epoch 317
Validation auc = 0.643079
Epoch 318
Validation auc = 0.647113
Epoch 319
Validation auc = 0.657362
Epoch 320
Loss = 3.0963e-01, PNorm = 94.3890, GNorm = 1.6627, lr_0 = 9.8534e-04
Loss = 4.4146e-02, PNorm = 94.4119, GNorm = 1.6818, lr_0 = 9.8532e-04
Validation auc = 0.668320
Epoch 321
Validation auc = 0.675298
Epoch 322
Validation auc = 0.667503
Epoch 323
Validation auc = 0.664995
Epoch 324
Validation auc = 0.674917
Epoch 325
Loss = 2.1556e-02, PNorm = 94.6686, GNorm = 0.2223, lr_0 = 9.8509e-04
Validation auc = 0.676661
Epoch 326
Validation auc = 0.673827
Epoch 327
Validation auc = 0.672191
Epoch 328
Validation auc = 0.668102
Epoch 329
Validation auc = 0.665595
Epoch 330
Loss = 5.5206e-02, PNorm = 94.9454, GNorm = 0.4481, lr_0 = 9.8483e-04
Validation auc = 0.663468
Epoch 331
Validation auc = 0.664395
Epoch 332
Validation auc = 0.664940
Epoch 333
Validation auc = 0.665431
Epoch 334
Loss = 3.6112e-02, PNorm = 95.0739, GNorm = 0.2324, lr_0 = 9.8461e-04
Loss = 3.1030e-03, PNorm = 95.0808, GNorm = 0.0753, lr_0 = 9.8459e-04
Validation auc = 0.663523
Epoch 335
Validation auc = 0.658834
Epoch 336
Validation auc = 0.656872
Epoch 337
Validation auc = 0.647768
Epoch 338
Validation auc = 0.656109
Epoch 339
Loss = 1.5810e-01, PNorm = 95.1662, GNorm = 3.5321, lr_0 = 9.8434e-04
Loss = 6.0000e-03, PNorm = 95.1783, GNorm = 0.1724, lr_0 = 9.8433e-04
Validation auc = 0.672409
Epoch 340
Validation auc = 0.673554
Epoch 341
Validation auc = 0.677316
Epoch 342
Validation auc = 0.680914
Epoch 343
Validation auc = 0.678842
Epoch 344
Loss = 1.0948e-01, PNorm = 95.3441, GNorm = 0.5559, lr_0 = 9.8410e-04
Validation auc = 0.677425
Epoch 345
Validation auc = 0.673881
Epoch 346
Validation auc = 0.671428
Epoch 347
Validation auc = 0.669356
Epoch 348
Validation auc = 0.667012
Epoch 349
Loss = 9.2847e-03, PNorm = 95.4949, GNorm = 0.1227, lr_0 = 9.8384e-04
Validation auc = 0.666140
Epoch 350
Validation auc = 0.663741
Epoch 351
Validation auc = 0.669520
Epoch 352
Validation auc = 0.676280
Epoch 353
Loss = 1.2791e-02, PNorm = 95.5991, GNorm = 0.2599, lr_0 = 9.8361e-04
Loss = 7.9637e-03, PNorm = 95.6088, GNorm = 0.2505, lr_0 = 9.8359e-04
Validation auc = 0.679932
Epoch 354
Validation auc = 0.668647
Epoch 355
Validation auc = 0.659052
Epoch 356
Validation auc = 0.655672
Epoch 357
Validation auc = 0.653492
Epoch 358
Loss = 9.9260e-02, PNorm = 95.7143, GNorm = 0.3053, lr_0 = 9.8335e-04
Validation auc = 0.653056
Epoch 359
Validation auc = 0.653764
Epoch 360
Validation auc = 0.652510
Epoch 361
Validation auc = 0.651638
Epoch 362
Validation auc = 0.651366
Epoch 363
Loss = 4.5581e-03, PNorm = 95.7740, GNorm = 0.0586, lr_0 = 9.8311e-04
Validation auc = 0.651148
Epoch 364
Validation auc = 0.654800
Epoch 365
Validation auc = 0.654473
Epoch 366
Validation auc = 0.654637
Epoch 367
Loss = 7.9994e-03, PNorm = 95.8414, GNorm = 0.3379, lr_0 = 9.8288e-04
Loss = 1.5104e-03, PNorm = 95.8500, GNorm = 0.0391, lr_0 = 9.8286e-04
Validation auc = 0.653001
Epoch 368
Validation auc = 0.656981
Epoch 369
Validation auc = 0.658562
Epoch 370
Validation auc = 0.662324
Epoch 371
Validation auc = 0.663414
Epoch 372
Loss = 5.9695e-02, PNorm = 96.0260, GNorm = 0.4612, lr_0 = 9.8262e-04
Loss = 2.9996e-03, PNorm = 96.0351, GNorm = 0.0679, lr_0 = 9.8260e-04
Validation auc = 0.665704
Epoch 373
Validation auc = 0.662705
Epoch 374
Validation auc = 0.661451
Epoch 375
Validation auc = 0.662160
Epoch 376
Validation auc = 0.663959
Epoch 377
Loss = 1.2839e-01, PNorm = 96.1361, GNorm = 0.6495, lr_0 = 9.8237e-04
Validation auc = 0.667448
Epoch 378
Validation auc = 0.669302
Epoch 379
Validation auc = 0.673281
Epoch 380
Validation auc = 0.675026
Epoch 381
Validation auc = 0.676062
Epoch 382
Loss = 2.2651e-03, PNorm = 96.2204, GNorm = 0.0397, lr_0 = 9.8211e-04
Validation auc = 0.675735
Epoch 383
Validation auc = 0.676116
Epoch 384
Validation auc = 0.676334
Epoch 385
Validation auc = 0.681132
Epoch 386
Loss = 5.8688e-03, PNorm = 96.2711, GNorm = 0.0629, lr_0 = 9.8189e-04
Loss = 8.2921e-04, PNorm = 96.2745, GNorm = 0.0432, lr_0 = 9.8187e-04
Validation auc = 0.680587
Epoch 387
Validation auc = 0.679769
Epoch 388
Validation auc = 0.678624
Epoch 389
Validation auc = 0.677643
Epoch 390
Validation auc = 0.677806
Epoch 391
Loss = 4.5280e-03, PNorm = 96.3212, GNorm = 0.0534, lr_0 = 9.8163e-04
Validation auc = 0.677043
Epoch 392
Validation auc = 0.674971
Epoch 393
Validation auc = 0.673881
Epoch 394
Validation auc = 0.672573
Epoch 395
Validation auc = 0.673281
Epoch 396
Loss = 1.0681e-01, PNorm = 96.3618, GNorm = 0.8247, lr_0 = 9.8138e-04
Validation auc = 0.667884
Epoch 397
Validation auc = 0.663250
Epoch 398
Validation auc = 0.662869
Epoch 399
Validation auc = 0.662542
Epoch 400
Loss = 5.8548e-03, PNorm = 96.4000, GNorm = 0.2693, lr_0 = 9.8116e-04
Loss = 4.3702e-03, PNorm = 96.4031, GNorm = 0.1382, lr_0 = 9.8114e-04
Validation auc = 0.663577
Epoch 401
Validation auc = 0.669193
Epoch 402
Validation auc = 0.673063
Epoch 403
Validation auc = 0.673281
Epoch 404
Validation auc = 0.670065
Epoch 405
Loss = 1.2510e-01, PNorm = 96.4754, GNorm = 0.4424, lr_0 = 9.8089e-04
Loss = 4.7753e-04, PNorm = 96.4920, GNorm = 0.0127, lr_0 = 9.8088e-04
Validation auc = 0.670174
Epoch 406
Validation auc = 0.663686
Epoch 407
Validation auc = 0.668920
Epoch 408
Validation auc = 0.673717
Epoch 409
Validation auc = 0.676280
Epoch 410
Loss = 9.6014e-02, PNorm = 96.7667, GNorm = 1.3883, lr_0 = 9.8065e-04
Validation auc = 0.691544
Epoch 411
Validation auc = 0.707845
Epoch 412
Validation auc = 0.704738
Epoch 413
Validation auc = 0.700267
Epoch 414
Validation auc = 0.698632
Epoch 415
Loss = 2.6323e-02, PNorm = 97.3960, GNorm = 0.5761, lr_0 = 9.8039e-04
Validation auc = 0.688492
Epoch 416
Validation auc = 0.676934
Epoch 417
Validation auc = 0.655073
Epoch 418
Validation auc = 0.661833
Epoch 419
Loss = 4.5395e-02, PNorm = 97.8157, GNorm = 0.6266, lr_0 = 9.8016e-04
Loss = 8.3384e-02, PNorm = 97.8483, GNorm = 3.4502, lr_0 = 9.8015e-04
Validation auc = 0.685002
Epoch 420
Validation auc = 0.683694
Epoch 421
Validation auc = 0.681132
Epoch 422
Validation auc = 0.680968
Epoch 423
Validation auc = 0.689473
Epoch 424
Loss = 5.1441e-02, PNorm = 98.2506, GNorm = 4.2995, lr_0 = 9.7990e-04
Validation auc = 0.687892
Epoch 425
Validation auc = 0.678024
Epoch 426
Validation auc = 0.671155
Epoch 427
Validation auc = 0.662051
Epoch 428
Validation auc = 0.654419
Epoch 429
Loss = 9.1599e-02, PNorm = 98.5134, GNorm = 2.1427, lr_0 = 9.7966e-04
Validation auc = 0.646514
Epoch 430
Validation auc = 0.645859
Epoch 431
Validation auc = 0.642643
Epoch 432
Validation auc = 0.645314
Epoch 433
Loss = 8.4231e-02, PNorm = 98.7806, GNorm = 5.4503, lr_0 = 9.7942e-04
Validation auc = 0.639808
Epoch 434
Validation auc = 0.628142
Epoch 435
Validation auc = 0.627596
Epoch 436
Validation auc = 0.635665
Epoch 437
Validation auc = 0.654637
Epoch 438
Loss = 2.8751e-02, PNorm = 99.1135, GNorm = 0.6931, lr_0 = 9.7917e-04
Loss = 4.6686e-02, PNorm = 99.1370, GNorm = 1.4248, lr_0 = 9.7916e-04
Validation auc = 0.658180
Epoch 439
Validation auc = 0.660197
Epoch 440
Validation auc = 0.662378
Epoch 441
Validation auc = 0.663196
Epoch 442
Validation auc = 0.664940
Epoch 443
Loss = 1.8623e-01, PNorm = 99.3747, GNorm = 0.8162, lr_0 = 9.7893e-04
Validation auc = 0.668702
Epoch 444
Validation auc = 0.669029
Epoch 445
Validation auc = 0.665104
Epoch 446
Validation auc = 0.671155
Epoch 447
Validation auc = 0.668102
Epoch 448
Loss = 5.5337e-03, PNorm = 99.5646, GNorm = 0.1058, lr_0 = 9.7867e-04
Validation auc = 0.665540
Epoch 449
Validation auc = 0.661778
Epoch 450
Validation auc = 0.651638
Epoch 451
Validation auc = 0.655236
Epoch 452
Loss = 5.1357e-02, PNorm = 100.0284, GNorm = 0.9886, lr_0 = 9.7845e-04
Loss = 5.6201e-03, PNorm = 100.0837, GNorm = 0.1210, lr_0 = 9.7843e-04
Validation auc = 0.657581
Epoch 453
Validation auc = 0.667230
Epoch 454
Validation auc = 0.664286
Epoch 455
Validation auc = 0.663741
Epoch 456
Validation auc = 0.660906
Epoch 457
Loss = 1.6838e-02, PNorm = 100.5986, GNorm = 0.2687, lr_0 = 9.7819e-04
Loss = 6.7750e-03, PNorm = 100.6208, GNorm = 0.1616, lr_0 = 9.7817e-04
Validation auc = 0.656272
Epoch 458
Validation auc = 0.650711
Epoch 459
Validation auc = 0.646786
Epoch 460
Validation auc = 0.644606
Epoch 461
Validation auc = 0.643842
Epoch 462
Loss = 9.9938e-03, PNorm = 100.8139, GNorm = 0.5290, lr_0 = 9.7794e-04
Validation auc = 0.640680
Epoch 463
Validation auc = 0.642425
Epoch 464
Validation auc = 0.641062
Epoch 465
Validation auc = 0.638718
Epoch 466
Loss = 8.8317e-03, PNorm = 100.9477, GNorm = 0.3139, lr_0 = 9.7770e-04
Validation auc = 0.639590
Epoch 467
Validation auc = 0.639863
Epoch 468
Validation auc = 0.639536
Epoch 469
Validation auc = 0.636646
Epoch 470
Validation auc = 0.632721
Epoch 471
Loss = 4.9669e-03, PNorm = 101.0413, GNorm = 0.0690, lr_0 = 9.7746e-04
Loss = 1.2025e-03, PNorm = 101.0457, GNorm = 0.0294, lr_0 = 9.7744e-04
Validation auc = 0.629886
Epoch 472
Validation auc = 0.627487
Epoch 473
Validation auc = 0.628905
Epoch 474
Validation auc = 0.629559
Epoch 475
Validation auc = 0.629777
Epoch 476
Loss = 2.6010e-03, PNorm = 101.0861, GNorm = 0.0443, lr_0 = 9.7721e-04
Validation auc = 0.628414
Epoch 477
Validation auc = 0.627760
Epoch 478
Validation auc = 0.628469
Epoch 479
Validation auc = 0.628469
Epoch 480
Validation auc = 0.627705
Epoch 481
Loss = 1.6986e-01, PNorm = 101.1261, GNorm = 0.7723, lr_0 = 9.7695e-04
Validation auc = 0.624816
Epoch 482
Validation auc = 0.622526
Epoch 483
Validation auc = 0.620509
Epoch 484
Validation auc = 0.618219
Epoch 485
Loss = 8.3360e-03, PNorm = 101.1514, GNorm = 0.2840, lr_0 = 9.7673e-04
Loss = 4.1330e-01, PNorm = 101.1759, GNorm = 19.7673, lr_0 = 9.7671e-04
Validation auc = 0.631685
Epoch 486
Validation auc = 0.652020
Epoch 487
Validation auc = 0.664668
Epoch 488
Validation auc = 0.652020
Epoch 489
Validation auc = 0.637355
Epoch 490
Loss = 2.6144e-01, PNorm = 101.9169, GNorm = 11.2097, lr_0 = 9.7647e-04
Loss = 1.7399e-01, PNorm = 101.9636, GNorm = 6.7811, lr_0 = 9.7645e-04
Validation auc = 0.669356
Epoch 491
Validation auc = 0.694597
Epoch 492
Validation auc = 0.682004
Epoch 493
Validation auc = 0.669193
Epoch 494
Validation auc = 0.640898
Epoch 495
Loss = 6.3152e-02, PNorm = 102.6920, GNorm = 0.5323, lr_0 = 9.7623e-04
Validation auc = 0.616693
Epoch 496
Validation auc = 0.596685
Epoch 497
Validation auc = 0.588290
Epoch 498
Validation auc = 0.580494
Epoch 499
Loss = 1.1481e-02, PNorm = 103.1054, GNorm = 0.7037, lr_0 = 9.7599e-04
Validation auc = 0.575751
Epoch 500
Validation auc = 0.582129
Epoch 501
Validation auc = 0.591125
Epoch 502
Validation auc = 0.606171
Epoch 503
Validation auc = 0.615276
Epoch 504
Loss = 1.0308e-02, PNorm = 103.2693, GNorm = 0.1908, lr_0 = 9.7574e-04
Loss = 1.5425e-02, PNorm = 103.2781, GNorm = 0.6054, lr_0 = 9.7573e-04
Validation auc = 0.623889
Epoch 505
Validation auc = 0.629832
Epoch 506
Validation auc = 0.632775
Epoch 507
Validation auc = 0.622308
Epoch 508
Validation auc = 0.585837
Epoch 509
Loss = 1.0293e-01, PNorm = 103.3981, GNorm = 2.0750, lr_0 = 9.7550e-04
Validation auc = 0.589489
Epoch 510
Validation auc = 0.593905
Epoch 511
Validation auc = 0.599520
Epoch 512
Validation auc = 0.583547
Epoch 513
Validation auc = 0.576242
Epoch 514
Loss = 2.2820e-03, PNorm = 103.5850, GNorm = 0.0603, lr_0 = 9.7524e-04
Validation auc = 0.591397
Epoch 515
Validation auc = 0.610751
Epoch 516
Validation auc = 0.626015
Epoch 517
Validation auc = 0.628796
Epoch 518
Loss = 1.0249e-02, PNorm = 103.6921, GNorm = 0.1033, lr_0 = 9.7502e-04
Loss = 3.7045e-02, PNorm = 103.7004, GNorm = 1.4568, lr_0 = 9.7500e-04
Validation auc = 0.624652
Epoch 519
Validation auc = 0.611787
Epoch 520
Validation auc = 0.635174
Epoch 521
Validation auc = 0.646623
Epoch 522
Validation auc = 0.652892
Epoch 523
Loss = 6.0272e-03, PNorm = 103.8416, GNorm = 0.0917, lr_0 = 9.7476e-04
Loss = 1.2936e-02, PNorm = 103.8503, GNorm = 0.3139, lr_0 = 9.7474e-04
Validation auc = 0.654419
Epoch 524
Validation auc = 0.654310
Epoch 525
Validation auc = 0.654691
Epoch 526
Validation auc = 0.653655
Epoch 527
Validation auc = 0.650602
Epoch 528
Loss = 5.5728e-03, PNorm = 103.9321, GNorm = 0.1475, lr_0 = 9.7452e-04
Validation auc = 0.646078
Epoch 529
Validation auc = 0.643951
Epoch 530
Validation auc = 0.638554
Epoch 531
Validation auc = 0.641117
Epoch 532
Validation auc = 0.643788
Epoch 533
Loss = 1.7859e-02, PNorm = 103.9963, GNorm = 0.2282, lr_0 = 9.7426e-04
Validation auc = 0.646350
Epoch 534
Validation auc = 0.646786
Epoch 535
Validation auc = 0.645968
Epoch 536
Validation auc = 0.644987
Epoch 537
Loss = 5.9493e-03, PNorm = 104.0667, GNorm = 0.2686, lr_0 = 9.7403e-04
Loss = 1.3962e-03, PNorm = 104.0722, GNorm = 0.0431, lr_0 = 9.7401e-04
Validation auc = 0.645205
Epoch 538
Validation auc = 0.646677
Epoch 539
Validation auc = 0.654637
Epoch 540
Validation auc = 0.653056
Epoch 541
Validation auc = 0.657417
Epoch 542
Loss = 1.4818e-03, PNorm = 104.2277, GNorm = 0.0711, lr_0 = 9.7379e-04
Validation auc = 0.659652
Epoch 543
Validation auc = 0.661778
Epoch 544
Validation auc = 0.649185
Epoch 545
Validation auc = 0.629995
Epoch 546
Validation auc = 0.614349
Epoch 547
Loss = 3.4492e-01, PNorm = 104.4179, GNorm = 1.4029, lr_0 = 9.7353e-04
Validation auc = 0.596249
Epoch 548
Validation auc = 0.581693
Epoch 549
Validation auc = 0.568173
Epoch 550
Validation auc = 0.559287
Epoch 551
Loss = 3.8312e-02, PNorm = 104.5025, GNorm = 0.0545, lr_0 = 9.7331e-04
Loss = 7.8056e-04, PNorm = 104.5088, GNorm = 0.0401, lr_0 = 9.7329e-04
Validation auc = 0.562013
Epoch 552
Validation auc = 0.577768
Epoch 553
Validation auc = 0.584038
Epoch 554
Validation auc = 0.585346
Epoch 555
Validation auc = 0.583656
Epoch 556
Loss = 3.4848e-03, PNorm = 104.5822, GNorm = 0.0603, lr_0 = 9.7305e-04
Loss = 7.7217e-04, PNorm = 104.5865, GNorm = 0.0227, lr_0 = 9.7303e-04
Validation auc = 0.583111
Epoch 557
Validation auc = 0.583438
Epoch 558
Validation auc = 0.584365
Epoch 559
Validation auc = 0.586109
Epoch 560
Validation auc = 0.585509
Epoch 561
Loss = 2.5985e-03, PNorm = 104.6268, GNorm = 0.0564, lr_0 = 9.7281e-04
Validation auc = 0.585128
Epoch 562
Validation auc = 0.584801
Epoch 563
Validation auc = 0.584038
Epoch 564
Validation auc = 0.581802
Epoch 565
Validation auc = 0.580058
Epoch 566
Loss = 1.3004e-03, PNorm = 104.6608, GNorm = 0.0272, lr_0 = 9.7255e-04
Validation auc = 0.579785
Epoch 567
Validation auc = 0.579349
Epoch 568
Validation auc = 0.576787
Epoch 569
Validation auc = 0.572807
Epoch 570
Loss = 1.3860e-03, PNorm = 104.7057, GNorm = 0.0347, lr_0 = 9.7232e-04
Loss = 1.2661e-03, PNorm = 104.7090, GNorm = 0.0336, lr_0 = 9.7231e-04
Validation auc = 0.566810
Epoch 571
Validation auc = 0.526740
Epoch 572
Validation auc = 0.541678
Epoch 573
Validation auc = 0.569373
Epoch 574
Validation auc = 0.591779
Epoch 575
Loss = 5.0712e-03, PNorm = 104.7618, GNorm = 0.1387, lr_0 = 9.7208e-04
Validation auc = 0.602900
Epoch 576
Validation auc = 0.622581
Epoch 577
Validation auc = 0.661124
Epoch 578
Validation auc = 0.675517
Epoch 579
Validation auc = 0.687347
Epoch 580
Loss = 1.2047e-02, PNorm = 104.9014, GNorm = 0.2863, lr_0 = 9.7182e-04
Validation auc = 0.682331
Epoch 581
Validation auc = 0.670501
Epoch 582
Validation auc = 0.665431
Epoch 583
Validation auc = 0.675026
Epoch 584
Loss = 9.1224e-02, PNorm = 105.0945, GNorm = 2.8018, lr_0 = 9.7160e-04
Loss = 3.8782e-04, PNorm = 105.1093, GNorm = 0.0179, lr_0 = 9.7158e-04
Validation auc = 0.680696
Epoch 585
Validation auc = 0.679551
Epoch 586
Validation auc = 0.671155
Epoch 587
Validation auc = 0.665104
Epoch 588
Validation auc = 0.663196
Epoch 589
Loss = 1.7550e-02, PNorm = 105.2920, GNorm = 0.1855, lr_0 = 9.7134e-04
Loss = 5.0324e-05, PNorm = 105.3010, GNorm = 0.0011, lr_0 = 9.7132e-04
Validation auc = 0.662814
Epoch 590
Validation auc = 0.660961
Epoch 591
Validation auc = 0.663196
Epoch 592
Validation auc = 0.666794
Epoch 593
Validation auc = 0.663250
Epoch 594
Loss = 9.2181e-02, PNorm = 105.3844, GNorm = 0.6761, lr_0 = 9.7110e-04
Validation auc = 0.662378
Epoch 595
Validation auc = 0.662051
Epoch 596
Validation auc = 0.657526
Epoch 597
Validation auc = 0.658725
Epoch 598
Validation auc = 0.654855
Epoch 599
Loss = 9.4940e-03, PNorm = 105.5428, GNorm = 0.2496, lr_0 = 9.7084e-04
Validation auc = 0.668429
Epoch 600
Validation auc = 0.700540
Epoch 601
Validation auc = 0.692635
Epoch 602
Validation auc = 0.681513
Epoch 603
Loss = 8.4000e-02, PNorm = 105.7719, GNorm = 1.5257, lr_0 = 9.7062e-04
Loss = 7.7809e-05, PNorm = 105.7886, GNorm = 0.0029, lr_0 = 9.7060e-04
Validation auc = 0.690182
Epoch 604
Validation auc = 0.711498
Epoch 605
Validation auc = 0.702884
Epoch 606
Validation auc = 0.698305
Epoch 607
Validation auc = 0.701466
Epoch 608
Loss = 7.9120e-02, PNorm = 105.9965, GNorm = 1.1364, lr_0 = 9.7036e-04
Validation auc = 0.707736
Epoch 609
Validation auc = 0.708881
Epoch 610
Validation auc = 0.706918
Epoch 611
Validation auc = 0.705719
Epoch 612
Validation auc = 0.705610
Epoch 613
Loss = 9.4710e-03, PNorm = 106.2007, GNorm = 0.2042, lr_0 = 9.7012e-04
Validation auc = 0.705610
Epoch 614
Validation auc = 0.706755
Epoch 615
Validation auc = 0.703756
Epoch 616
Validation auc = 0.701576
Epoch 617
Loss = 5.1110e-03, PNorm = 106.3164, GNorm = 0.1147, lr_0 = 9.6990e-04
Loss = 3.6219e-03, PNorm = 106.3227, GNorm = 0.1350, lr_0 = 9.6988e-04
Validation auc = 0.699395
Epoch 618
Validation auc = 0.700322
Epoch 619
Validation auc = 0.695143
Epoch 620
Validation auc = 0.690454
Epoch 621
Validation auc = 0.685439
Epoch 622
Loss = 1.2894e-01, PNorm = 106.4530, GNorm = 1.5605, lr_0 = 9.6964e-04
Loss = 5.4465e-02, PNorm = 106.4718, GNorm = 1.5192, lr_0 = 9.6962e-04
Validation auc = 0.684621
Epoch 623
Validation auc = 0.685330
Epoch 624
Validation auc = 0.685439
Epoch 625
Validation auc = 0.689527
Epoch 626
Validation auc = 0.693780
Epoch 627
Loss = 2.3565e-02, PNorm = 106.6876, GNorm = 0.5765, lr_0 = 9.6940e-04
Validation auc = 0.699122
Epoch 628
Validation auc = 0.700376
Epoch 629
Validation auc = 0.699831
Epoch 630
Validation auc = 0.698305
Epoch 631
Validation auc = 0.697541
Epoch 632
Loss = 1.0876e-02, PNorm = 106.8563, GNorm = 0.2547, lr_0 = 9.6914e-04
Validation auc = 0.696669
Epoch 633
Validation auc = 0.695470
Epoch 634
Validation auc = 0.694434
Epoch 635
Validation auc = 0.693834
Epoch 636
Loss = 1.8322e-02, PNorm = 106.9097, GNorm = 0.2103, lr_0 = 9.6892e-04
Loss = 4.6555e-04, PNorm = 106.9119, GNorm = 0.0150, lr_0 = 9.6890e-04
Validation auc = 0.690999
Epoch 637
Validation auc = 0.690236
Epoch 638
Validation auc = 0.688055
Epoch 639
Validation auc = 0.685657
Epoch 640
Validation auc = 0.681731
Epoch 641
Loss = 1.9197e-03, PNorm = 106.9388, GNorm = 0.0161, lr_0 = 9.6866e-04
Validation auc = 0.679769
Epoch 642
Validation auc = 0.678406
Epoch 643
Validation auc = 0.676716
Epoch 644
Validation auc = 0.674045
Epoch 645
Validation auc = 0.669574
Epoch 646
Loss = 1.2506e-03, PNorm = 106.9578, GNorm = 0.0164, lr_0 = 9.6842e-04
Validation auc = 0.666140
Epoch 647
Validation auc = 0.662760
Epoch 648
Validation auc = 0.654419
Epoch 649
Validation auc = 0.646895
Epoch 650
Loss = 3.2557e-03, PNorm = 106.9784, GNorm = 0.0696, lr_0 = 9.6820e-04
Loss = 3.6394e-04, PNorm = 106.9799, GNorm = 0.0103, lr_0 = 9.6818e-04
Validation auc = 0.642643
Epoch 651
Validation auc = 0.641171
Epoch 652
Validation auc = 0.642425
Epoch 653
Validation auc = 0.643297
Epoch 654
Validation auc = 0.643951
Epoch 655
Loss = 1.1948e-03, PNorm = 106.9989, GNorm = 0.0229, lr_0 = 9.6794e-04
Loss = 9.9342e-05, PNorm = 106.9999, GNorm = 0.0051, lr_0 = 9.6792e-04
Validation auc = 0.643897
Epoch 656
Validation auc = 0.643297
Epoch 657
Validation auc = 0.643297
Epoch 658
Validation auc = 0.641444
Epoch 659
Validation auc = 0.640135
Epoch 660
Loss = 3.2735e-03, PNorm = 107.0188, GNorm = 0.0849, lr_0 = 9.6770e-04
Validation auc = 0.639645
Epoch 661
Validation auc = 0.640353
Epoch 662
Validation auc = 0.640571
Epoch 663
Validation auc = 0.640408
Epoch 664
Validation auc = 0.639917
Epoch 665
Loss = 3.5505e-01, PNorm = 107.0432, GNorm = 2.2104, lr_0 = 9.6744e-04
Validation auc = 0.635828
Epoch 666
Validation auc = 0.630922
Epoch 667
Validation auc = 0.629068
Epoch 668
Validation auc = 0.628850
Epoch 669
Loss = 5.2306e-03, PNorm = 107.0502, GNorm = 0.0176, lr_0 = 9.6722e-04
Loss = 1.2687e-03, PNorm = 107.0519, GNorm = 0.0261, lr_0 = 9.6720e-04
Validation auc = 0.632394
Epoch 670
Validation auc = 0.633484
Epoch 671
Validation auc = 0.616911
Epoch 672
Validation auc = 0.608843
Epoch 673
Validation auc = 0.672954
Epoch 674
Loss = 1.0503e-02, PNorm = 107.1238, GNorm = 0.1387, lr_0 = 9.6696e-04
Validation auc = 0.688055
Epoch 675
Validation auc = 0.695143
Epoch 676
Validation auc = 0.695688
Epoch 677
Validation auc = 0.693344
Epoch 678
Validation auc = 0.692199
Epoch 679
Loss = 7.8107e-03, PNorm = 107.2767, GNorm = 0.1340, lr_0 = 9.6672e-04
Validation auc = 0.692199
Epoch 680
Validation auc = 0.691708
Epoch 681
Validation auc = 0.692417
Epoch 682
Validation auc = 0.690727
Epoch 683
Loss = 2.6754e-03, PNorm = 107.3583, GNorm = 0.1250, lr_0 = 9.6648e-04
Validation auc = 0.690890
Epoch 684
Validation auc = 0.696124
Epoch 685
Validation auc = 0.701303
Epoch 686
Validation auc = 0.701030
Epoch 687
Validation auc = 0.700322
Epoch 688
Loss = 4.6192e-03, PNorm = 107.4175, GNorm = 0.0711, lr_0 = 9.6624e-04
Loss = 1.6119e-04, PNorm = 107.4216, GNorm = 0.0061, lr_0 = 9.6622e-04
Validation auc = 0.698414
Epoch 689
Validation auc = 0.696560
Epoch 690
Validation auc = 0.694815
Epoch 691
Validation auc = 0.693780
Epoch 692
Validation auc = 0.693289
Epoch 693
Loss = 9.6198e-04, PNorm = 107.4554, GNorm = 0.0238, lr_0 = 9.6600e-04
Validation auc = 0.692907
Epoch 694
Validation auc = 0.692471
Epoch 695
Validation auc = 0.692199
Epoch 696
Validation auc = 0.694270
Epoch 697
Validation auc = 0.696560
Epoch 698
Loss = 4.1029e-03, PNorm = 107.4700, GNorm = 0.1036, lr_0 = 9.6574e-04
Validation auc = 0.698904
Epoch 699
Validation auc = 0.698850
Epoch 700
Validation auc = 0.699231
Epoch 701
Validation auc = 0.698305
Epoch 702
Loss = 1.1664e-02, PNorm = 107.4997, GNorm = 0.7612, lr_0 = 9.6552e-04
Loss = 1.4811e-04, PNorm = 107.5019, GNorm = 0.0064, lr_0 = 9.6550e-04
Validation auc = 0.699667
Epoch 703
Validation auc = 0.701794
Epoch 704
Validation auc = 0.703375
Epoch 705
Validation auc = 0.706155
Epoch 706
Validation auc = 0.706864
Epoch 707
Loss = 1.5517e-03, PNorm = 107.5351, GNorm = 0.0324, lr_0 = 9.6526e-04
Loss = 4.2844e-04, PNorm = 107.5372, GNorm = 0.0300, lr_0 = 9.6525e-04
Validation auc = 0.707518
Epoch 708
Validation auc = 0.707681
Epoch 709
Validation auc = 0.707899
Epoch 710
Validation auc = 0.705664
Epoch 711
Validation auc = 0.706318
Epoch 712
Loss = 1.7078e-03, PNorm = 107.5654, GNorm = 0.0374, lr_0 = 9.6502e-04
Validation auc = 0.707300
Epoch 713
Validation auc = 0.706209
Epoch 714
Validation auc = 0.706809
Epoch 715
Validation auc = 0.708118
Epoch 716
Loss = 2.8463e-03, PNorm = 107.5865, GNorm = 0.0215, lr_0 = 9.6479e-04
Validation auc = 0.708281
Epoch 717
Validation auc = 0.707954
Epoch 718
Validation auc = 0.706700
Epoch 719
Validation auc = 0.705991
Epoch 720
Validation auc = 0.705174
Epoch 721
Loss = 6.4159e-04, PNorm = 107.6238, GNorm = 0.0086, lr_0 = 9.6455e-04
Loss = 8.1261e-04, PNorm = 107.6261, GNorm = 0.0296, lr_0 = 9.6453e-04
Validation auc = 0.704247
Epoch 722
Validation auc = 0.703157
Epoch 723
Validation auc = 0.703429
Epoch 724
Validation auc = 0.701303
Epoch 725
Validation auc = 0.699504
Epoch 726
Loss = 1.2201e-03, PNorm = 107.6688, GNorm = 0.0274, lr_0 = 9.6431e-04
Validation auc = 0.696778
Epoch 727
Validation auc = 0.691653
Epoch 728
Validation auc = 0.687674
Epoch 729
Validation auc = 0.685330
Epoch 730
Validation auc = 0.683749
Epoch 731
Loss = 2.5491e-03, PNorm = 107.7085, GNorm = 0.0970, lr_0 = 9.6405e-04
Validation auc = 0.682767
Epoch 732
Validation auc = 0.681677
Epoch 733
Validation auc = 0.680859
Epoch 734
Validation auc = 0.680696
Epoch 735
Loss = 4.5950e-04, PNorm = 107.7227, GNorm = 0.0055, lr_0 = 9.6383e-04
Loss = 5.9804e-04, PNorm = 107.7234, GNorm = 0.0185, lr_0 = 9.6381e-04
Validation auc = 0.680532
Epoch 736
Validation auc = 0.681677
Epoch 737
Validation auc = 0.683312
Epoch 738
Validation auc = 0.685275
Epoch 739
Validation auc = 0.686474
Epoch 740
Loss = 1.0225e-02, PNorm = 107.7314, GNorm = 0.1523, lr_0 = 9.6357e-04
Loss = 4.1303e-04, PNorm = 107.7325, GNorm = 0.0144, lr_0 = 9.6355e-04
Validation auc = 0.686692
Epoch 741
Validation auc = 0.687565
Epoch 742
Validation auc = 0.687183
Epoch 743
Validation auc = 0.685711
Epoch 744
Validation auc = 0.684021
Epoch 745
Loss = 1.1893e-03, PNorm = 107.7479, GNorm = 0.0411, lr_0 = 9.6333e-04
Validation auc = 0.683149
Epoch 746
Validation auc = 0.682985
Epoch 747
Validation auc = 0.682495
Epoch 748
Validation auc = 0.681895
Epoch 749
Loss = 6.7768e-04, PNorm = 107.7614, GNorm = 0.0041, lr_0 = 9.6309e-04
Validation auc = 0.681950
Epoch 750
Validation auc = 0.681895
Epoch 751
Validation auc = 0.682168
Epoch 752
Validation auc = 0.681840
Epoch 753
Validation auc = 0.679551
Epoch 754
Loss = 6.2335e-04, PNorm = 107.7678, GNorm = 0.0236, lr_0 = 9.6285e-04
Loss = 2.6543e-05, PNorm = 107.7682, GNorm = 0.0008, lr_0 = 9.6284e-04
Validation auc = 0.678897
Epoch 755
Validation auc = 0.679224
Epoch 756
Validation auc = 0.679823
Epoch 757
Validation auc = 0.676171
Epoch 758
Validation auc = 0.673445
Epoch 759
Loss = 2.7784e-04, PNorm = 107.7818, GNorm = 0.0063, lr_0 = 9.6262e-04
Validation auc = 0.672736
Epoch 760
Validation auc = 0.672137
Epoch 761
Validation auc = 0.672355
Epoch 762
Validation auc = 0.672627
Epoch 763
Validation auc = 0.674208
Epoch 764
Loss = 5.9601e-03, PNorm = 107.8033, GNorm = 0.3979, lr_0 = 9.6236e-04
Validation auc = 0.676552
Epoch 765
Validation auc = 0.678406
Epoch 766
Validation auc = 0.679224
Epoch 767
Validation auc = 0.679714
Epoch 768
Loss = 7.0788e-03, PNorm = 107.8376, GNorm = 0.3741, lr_0 = 9.6214e-04
Loss = 2.3680e-03, PNorm = 107.8402, GNorm = 0.0856, lr_0 = 9.6212e-04
Validation auc = 0.680259
Epoch 769
Validation auc = 0.682277
Epoch 770
Validation auc = 0.682985
Epoch 771
Validation auc = 0.682985
Epoch 772
Validation auc = 0.682876
Epoch 773
Loss = 2.7249e-02, PNorm = 107.8635, GNorm = 0.4444, lr_0 = 9.6188e-04
Loss = 2.0593e-03, PNorm = 107.8645, GNorm = 0.0643, lr_0 = 9.6186e-04
Validation auc = 0.683203
Epoch 774
Validation auc = 0.683312
Epoch 775
Validation auc = 0.683749
Epoch 776
Validation auc = 0.683803
Epoch 777
Validation auc = 0.683640
Epoch 778
Loss = 2.5358e-04, PNorm = 107.8787, GNorm = 0.0053, lr_0 = 9.6164e-04
Validation auc = 0.683640
Epoch 779
Validation auc = 0.683312
Epoch 780
Validation auc = 0.683094
Epoch 781
Validation auc = 0.683040
Epoch 782
Validation auc = 0.682822
Epoch 783
Loss = 3.2060e-04, PNorm = 107.8889, GNorm = 0.0055, lr_0 = 9.6139e-04
Validation auc = 0.683094
Epoch 784
Validation auc = 0.683203
Epoch 785
Validation auc = 0.682876
Epoch 786
Validation auc = 0.682767
Epoch 787
Loss = 3.5316e-04, PNorm = 107.8950, GNorm = 0.0042, lr_0 = 9.6117e-04
Loss = 2.5382e-03, PNorm = 107.8956, GNorm = 0.0488, lr_0 = 9.6115e-04
Validation auc = 0.682822
Epoch 788
Validation auc = 0.682876
Epoch 789
Validation auc = 0.683858
Epoch 790
Validation auc = 0.684294
Epoch 791
Validation auc = 0.685111
Epoch 792
Loss = 4.2870e-04, PNorm = 107.9004, GNorm = 0.0132, lr_0 = 9.6093e-04
Validation auc = 0.685221
Epoch 793
Validation auc = 0.685439
Epoch 794
Validation auc = 0.686965
Epoch 795
Validation auc = 0.687728
Epoch 796
Validation auc = 0.687892
Epoch 797
Loss = 3.6451e-04, PNorm = 107.9161, GNorm = 0.0058, lr_0 = 9.6067e-04
Validation auc = 0.688219
Epoch 798
Validation auc = 0.688437
Epoch 799
Validation auc = 0.686692
Epoch 800
Validation auc = 0.685929
Epoch 801
Loss = 1.5783e-02, PNorm = 107.9234, GNorm = 1.1998, lr_0 = 9.6045e-04
Loss = 4.1205e-04, PNorm = 107.9233, GNorm = 0.0108, lr_0 = 9.6043e-04
Validation auc = 0.689146
Epoch 802
Validation auc = 0.691872
Epoch 803
Validation auc = 0.693453
Epoch 804
Validation auc = 0.693616
Epoch 805
Validation auc = 0.694379
Epoch 806
Loss = 4.2883e-04, PNorm = 107.9341, GNorm = 0.0088, lr_0 = 9.6019e-04
Loss = 2.4375e-04, PNorm = 107.9350, GNorm = 0.0085, lr_0 = 9.6018e-04
Validation auc = 0.694543
Epoch 807
Validation auc = 0.694761
Epoch 808
Validation auc = 0.694979
Epoch 809
Validation auc = 0.694815
Epoch 810
Validation auc = 0.694652
Epoch 811
Loss = 4.1279e-04, PNorm = 107.9462, GNorm = 0.0080, lr_0 = 9.5996e-04
Validation auc = 0.695252
Epoch 812
Validation auc = 0.695143
Epoch 813
Validation auc = 0.694870
Epoch 814
Validation auc = 0.694870
Epoch 815
Validation auc = 0.694161
Epoch 816
Loss = 1.6603e-04, PNorm = 107.9586, GNorm = 0.0043, lr_0 = 9.5970e-04
Validation auc = 0.693725
Epoch 817
Validation auc = 0.692417
Epoch 818
Validation auc = 0.690563
Epoch 819
Validation auc = 0.689909
Epoch 820
Loss = 4.5968e-03, PNorm = 107.9511, GNorm = 0.0292, lr_0 = 9.5948e-04
Loss = 5.9836e-04, PNorm = 107.9520, GNorm = 0.0196, lr_0 = 9.5946e-04
Validation auc = 0.689691
Epoch 821
Validation auc = 0.689527
Epoch 822
Validation auc = 0.688819
Epoch 823
Validation auc = 0.689146
Epoch 824
Validation auc = 0.689146
Epoch 825
Loss = 4.8402e-04, PNorm = 107.9647, GNorm = 0.0117, lr_0 = 9.5924e-04
Validation auc = 0.689527
Epoch 826
Validation auc = 0.689255
Epoch 827
Validation auc = 0.689418
Epoch 828
Validation auc = 0.689745
Epoch 829
Validation auc = 0.690454
Epoch 830
Loss = 6.2392e-04, PNorm = 107.9742, GNorm = 0.0192, lr_0 = 9.5899e-04
Validation auc = 0.690672
Epoch 831
Validation auc = 0.691217
Epoch 832
Validation auc = 0.691544
Epoch 833
Validation auc = 0.691490
Epoch 834
Loss = 1.7504e-03, PNorm = 107.9913, GNorm = 0.0141, lr_0 = 9.5877e-04
Loss = 1.8154e-03, PNorm = 107.9926, GNorm = 0.0454, lr_0 = 9.5875e-04
Validation auc = 0.692199
Epoch 835
Validation auc = 0.691926
Epoch 836
Validation auc = 0.691544
Epoch 837
Validation auc = 0.691653
Epoch 838
Validation auc = 0.691817
Epoch 839
Loss = 3.0604e-04, PNorm = 108.0067, GNorm = 0.0112, lr_0 = 9.5851e-04
Loss = 7.0937e-05, PNorm = 108.0073, GNorm = 0.0033, lr_0 = 9.5849e-04
Validation auc = 0.691763
Epoch 840
Validation auc = 0.691763
Epoch 841
Validation auc = 0.691490
Epoch 842
Validation auc = 0.691708
Epoch 843
Validation auc = 0.692090
Epoch 844
Loss = 3.8840e-04, PNorm = 108.0146, GNorm = 0.0140, lr_0 = 9.5827e-04
Validation auc = 0.692907
Epoch 845
Validation auc = 0.693071
Epoch 846
Validation auc = 0.693616
Epoch 847
Validation auc = 0.693507
Epoch 848
Validation auc = 0.693725
Epoch 849
Loss = 1.1643e-03, PNorm = 108.0200, GNorm = 0.0875, lr_0 = 9.5802e-04
Validation auc = 0.694379
Epoch 850
Validation auc = 0.694706
Epoch 851
Validation auc = 0.695088
Epoch 852
Validation auc = 0.694924
Epoch 853
Loss = 2.1902e-04, PNorm = 108.0261, GNorm = 0.0031, lr_0 = 9.5780e-04
Loss = 9.3670e-05, PNorm = 108.0265, GNorm = 0.0032, lr_0 = 9.5778e-04
Validation auc = 0.694761
Epoch 854
Validation auc = 0.694597
Epoch 855
Validation auc = 0.694597
Epoch 856
Validation auc = 0.694325
Epoch 857
Validation auc = 0.694216
Epoch 858
Loss = 1.7603e-04, PNorm = 108.0315, GNorm = 0.0032, lr_0 = 9.5754e-04
Validation auc = 0.694107
Epoch 859
Validation auc = 0.693943
Epoch 860
Validation auc = 0.693943
Epoch 861
Validation auc = 0.696996
Epoch 862
Validation auc = 0.698523
Epoch 863
Loss = 3.1874e-04, PNorm = 108.0485, GNorm = 0.0070, lr_0 = 9.5730e-04
Validation auc = 0.698141
Epoch 864
Validation auc = 0.698850
Epoch 865
Validation auc = 0.698795
Epoch 866
Validation auc = 0.698686
Epoch 867
Loss = 1.5769e-04, PNorm = 108.0758, GNorm = 0.0033, lr_0 = 9.5708e-04
Loss = 1.6212e-05, PNorm = 108.0772, GNorm = 0.0007, lr_0 = 9.5707e-04
Validation auc = 0.698141
Epoch 868
Validation auc = 0.697759
Epoch 869
Validation auc = 0.696942
Epoch 870
Validation auc = 0.697051
Epoch 871
Validation auc = 0.697105
Epoch 872
Loss = 1.4193e-04, PNorm = 108.0904, GNorm = 0.0052, lr_0 = 9.5683e-04
Loss = 8.8421e-03, PNorm = 108.0921, GNorm = 0.4220, lr_0 = 9.5681e-04
Validation auc = 0.697269
Epoch 873
Validation auc = 0.698359
Epoch 874
Validation auc = 0.699776
Epoch 875
Validation auc = 0.700431
Epoch 876
Validation auc = 0.700158
Epoch 877
Loss = 7.1670e-04, PNorm = 108.1162, GNorm = 0.0157, lr_0 = 9.5659e-04
Validation auc = 0.700594
Epoch 878
Validation auc = 0.700431
Epoch 879
Validation auc = 0.700485
Epoch 880
Validation auc = 0.701466
Epoch 881
Validation auc = 0.701412
Epoch 882
Loss = 8.8552e-04, PNorm = 108.1318, GNorm = 0.0213, lr_0 = 9.5634e-04
Validation auc = 0.701903
Epoch 883
Validation auc = 0.701630
Epoch 884
Validation auc = 0.701630
Epoch 885
Validation auc = 0.701030
Epoch 886
Loss = 3.7480e-04, PNorm = 108.1423, GNorm = 0.0175, lr_0 = 9.5612e-04
Loss = 3.2919e-04, PNorm = 108.1430, GNorm = 0.0112, lr_0 = 9.5610e-04
Validation auc = 0.700976
Epoch 887
Validation auc = 0.700540
Epoch 888
Validation auc = 0.700158
Epoch 889
Validation auc = 0.700158
Epoch 890
Validation auc = 0.700158
Epoch 891
Loss = 2.6688e-04, PNorm = 108.1514, GNorm = 0.0019, lr_0 = 9.5586e-04
Validation auc = 0.699776
Epoch 892
Validation auc = 0.699995
Epoch 893
Validation auc = 0.700594
Epoch 894
Validation auc = 0.700158
Epoch 895
Validation auc = 0.699722
Epoch 896
Loss = 1.9239e-04, PNorm = 108.1625, GNorm = 0.0041, lr_0 = 9.5563e-04
Validation auc = 0.699886
Epoch 897
Validation auc = 0.700213
Epoch 898
Validation auc = 0.700485
Epoch 899
Validation auc = 0.699831
Epoch 900
Loss = 1.9968e-04, PNorm = 108.1701, GNorm = 0.0032, lr_0 = 9.5541e-04
Loss = 1.7405e-04, PNorm = 108.1706, GNorm = 0.0101, lr_0 = 9.5539e-04
Validation auc = 0.699395
Epoch 901
Validation auc = 0.699231
Epoch 902
Validation auc = 0.698959
Epoch 903
Validation auc = 0.698959
Epoch 904
Validation auc = 0.698850
Epoch 905
Loss = 1.0595e-04, PNorm = 108.1770, GNorm = 0.0089, lr_0 = 9.5515e-04
Loss = 1.6219e-04, PNorm = 108.1775, GNorm = 0.0099, lr_0 = 9.5513e-04
Validation auc = 0.698741
Epoch 906
Validation auc = 0.698359
Epoch 907
Validation auc = 0.697977
Epoch 908
Validation auc = 0.697923
Epoch 909
Validation auc = 0.698195
Epoch 910
Loss = 4.7142e-05, PNorm = 108.1828, GNorm = 0.0014, lr_0 = 9.5491e-04
Validation auc = 0.698250
Epoch 911
Validation auc = 0.698141
Epoch 912
Validation auc = 0.698414
Epoch 913
Validation auc = 0.698195
Epoch 914
Validation auc = 0.698250
Epoch 915
Loss = 1.8400e-04, PNorm = 108.1876, GNorm = 0.0071, lr_0 = 9.5466e-04
Validation auc = 0.698632
Epoch 916
Validation auc = 0.698468
Epoch 917
Validation auc = 0.698904
Epoch 918
Validation auc = 0.699231
Epoch 919
Loss = 5.8684e-05, PNorm = 108.1906, GNorm = 0.0033, lr_0 = 9.5444e-04
Loss = 1.5993e-05, PNorm = 108.1908, GNorm = 0.0005, lr_0 = 9.5442e-04
Validation auc = 0.699667
Epoch 920
Validation auc = 0.698686
Epoch 921
Validation auc = 0.698686
Epoch 922
Validation auc = 0.697378
Epoch 923
Validation auc = 0.695361
Epoch 924
Loss = 1.6266e-03, PNorm = 108.1998, GNorm = 0.1427, lr_0 = 9.5419e-04
Validation auc = 0.694379
Epoch 925
Validation auc = 0.696505
Epoch 926
Validation auc = 0.699177
Epoch 927
Validation auc = 0.701085
Epoch 928
Validation auc = 0.702121
Epoch 929
Loss = 4.8880e-04, PNorm = 108.2212, GNorm = 0.0115, lr_0 = 9.5395e-04
Validation auc = 0.703211
Epoch 930
Validation auc = 0.703756
Epoch 931
Validation auc = 0.703865
Epoch 932
Validation auc = 0.703756
Epoch 933
Loss = 1.4650e-04, PNorm = 108.2322, GNorm = 0.0000, lr_0 = 9.5371e-04
Validation auc = 0.703920
Epoch 934
Validation auc = 0.703865
Epoch 935
Validation auc = 0.702393
Epoch 936
Validation auc = 0.700104
Epoch 937
Validation auc = 0.698468
Epoch 938
Loss = 1.7540e-04, PNorm = 108.2354, GNorm = 0.0056, lr_0 = 9.5348e-04
Loss = 1.1129e-04, PNorm = 108.2356, GNorm = 0.0037, lr_0 = 9.5346e-04
Validation auc = 0.696669
Epoch 939
Validation auc = 0.696015
Epoch 940
Validation auc = 0.695960
Epoch 941
Validation auc = 0.695197
Epoch 942
Validation auc = 0.694706
Epoch 943
Loss = 6.3400e-05, PNorm = 108.2391, GNorm = 0.0017, lr_0 = 9.5324e-04
Validation auc = 0.694379
Epoch 944
Validation auc = 0.693998
Epoch 945
Validation auc = 0.693889
Epoch 946
Validation auc = 0.693834
Epoch 947
Validation auc = 0.693725
Epoch 948
Loss = 4.6489e-05, PNorm = 108.2425, GNorm = 0.0012, lr_0 = 9.5299e-04
Validation auc = 0.693671
Epoch 949
Validation auc = 0.693780
Epoch 950
Validation auc = 0.693725
Epoch 951
Validation auc = 0.693834
Epoch 952
Loss = 5.9095e-04, PNorm = 108.2451, GNorm = 0.0770, lr_0 = 9.5277e-04
Loss = 5.1991e-05, PNorm = 108.2452, GNorm = 0.0017, lr_0 = 9.5275e-04
Validation auc = 0.693889
Epoch 953
Validation auc = 0.693889
Epoch 954
Validation auc = 0.694052
Epoch 955
Validation auc = 0.693889
Epoch 956
Validation auc = 0.694107
Epoch 957
Loss = 1.3943e-04, PNorm = 108.2491, GNorm = 0.0038, lr_0 = 9.5251e-04
Loss = 1.5417e-05, PNorm = 108.2493, GNorm = 0.0006, lr_0 = 9.5250e-04
Validation auc = 0.693998
Epoch 958
Validation auc = 0.693998
Epoch 959
Validation auc = 0.689473
Epoch 960
Validation auc = 0.686256
Epoch 961
Validation auc = 0.686202
Epoch 962
Loss = 2.7137e-03, PNorm = 108.2530, GNorm = 0.0842, lr_0 = 9.5228e-04
Validation auc = 0.686147
Epoch 963
Validation auc = 0.685984
Epoch 964
Validation auc = 0.686202
Epoch 965
Validation auc = 0.686747
Epoch 966
Loss = 2.8564e-04, PNorm = 108.2639, GNorm = 0.0007, lr_0 = 9.5204e-04
Validation auc = 0.687347
Epoch 967
Validation auc = 0.687238
Epoch 968
Validation auc = 0.687837
Epoch 969
Validation auc = 0.687783
Epoch 970
Validation auc = 0.688001
Epoch 971
Loss = 1.6333e-04, PNorm = 108.2714, GNorm = 0.0081, lr_0 = 9.5180e-04
Loss = 7.0566e-05, PNorm = 108.2717, GNorm = 0.0030, lr_0 = 9.5179e-04
Validation auc = 0.688546
Epoch 972
Validation auc = 0.688928
Epoch 973
Validation auc = 0.689418
Epoch 974
Validation auc = 0.689527
Epoch 975
Validation auc = 0.689691
Epoch 976
Loss = 1.9382e-04, PNorm = 108.2754, GNorm = 0.0098, lr_0 = 9.5157e-04
Validation auc = 0.689691
Epoch 977
Validation auc = 0.689909
Epoch 978
Validation auc = 0.690236
Epoch 979
Validation auc = 0.691326
Epoch 980
Validation auc = 0.692744
Epoch 981
Loss = 1.7991e-04, PNorm = 108.2806, GNorm = 0.0133, lr_0 = 9.5132e-04
Validation auc = 0.693834
Epoch 982
Validation auc = 0.694325
Epoch 983
Validation auc = 0.694706
Epoch 984
Validation auc = 0.694924
Epoch 985
Loss = 1.0024e-04, PNorm = 108.2844, GNorm = 0.0010, lr_0 = 9.5110e-04
Loss = 3.7249e-05, PNorm = 108.2846, GNorm = 0.0014, lr_0 = 9.5108e-04
Validation auc = 0.695361
Epoch 986
Validation auc = 0.695579
Epoch 987
Validation auc = 0.695688
Epoch 988
Validation auc = 0.695797
Epoch 989
Validation auc = 0.695851
Epoch 990
Loss = 6.9901e-05, PNorm = 108.2872, GNorm = 0.0016, lr_0 = 9.5084e-04
Loss = 2.4835e-06, PNorm = 108.2874, GNorm = 0.0001, lr_0 = 9.5083e-04
Validation auc = 0.695960
Epoch 991
Validation auc = 0.696124
Epoch 992
Validation auc = 0.695252
Epoch 993
Validation auc = 0.694216
Epoch 994
Validation auc = 0.694325
Epoch 995
Loss = 1.1237e-04, PNorm = 108.2992, GNorm = 0.0028, lr_0 = 9.5061e-04
Validation auc = 0.694706
Epoch 996
Validation auc = 0.695252
Epoch 997
Validation auc = 0.696396
Epoch 998
Validation auc = 0.697378
Epoch 999
Loss = 6.6084e-05, PNorm = 108.3202, GNorm = 0.0000, lr_0 = 9.5037e-04
Validation auc = 0.698305
Epoch 1000
Validation auc = 0.698523
Epoch 1001
Validation auc = 0.698741
Epoch 1002
Validation auc = 0.699286
Epoch 1003
Validation auc = 0.699177
Epoch 1004
Loss = 6.0295e-05, PNorm = 108.3281, GNorm = 0.0008, lr_0 = 9.5014e-04
Loss = 2.4518e-04, PNorm = 108.3285, GNorm = 0.0060, lr_0 = 9.5012e-04
Validation auc = 0.698795
Epoch 1005
Validation auc = 0.698195
Epoch 1006
Validation auc = 0.698086
Epoch 1007
Validation auc = 0.698032
Epoch 1008
Validation auc = 0.697814
Epoch 1009
Loss = 9.4519e-05, PNorm = 108.3322, GNorm = 0.0025, lr_0 = 9.4990e-04
Validation auc = 0.697705
Epoch 1010
Validation auc = 0.697923
Epoch 1011
Validation auc = 0.697923
Epoch 1012
Validation auc = 0.697977
Epoch 1013
Validation auc = 0.697705
Epoch 1014
Loss = 5.0176e-05, PNorm = 108.3350, GNorm = 0.0012, lr_0 = 9.4965e-04
Validation auc = 0.697814
Epoch 1015
Validation auc = 0.697650
Epoch 1016
Validation auc = 0.694543
Epoch 1017
Validation auc = 0.693943
Epoch 1018
Loss = 1.9462e-03, PNorm = 108.3372, GNorm = 0.1103, lr_0 = 9.4943e-04
Loss = 5.6140e-05, PNorm = 108.3377, GNorm = 0.0035, lr_0 = 9.4941e-04
Validation auc = 0.692362
Epoch 1019
Validation auc = 0.692308
Epoch 1020
Validation auc = 0.692308
Epoch 1021
Validation auc = 0.693016
Epoch 1022
Validation auc = 0.693507
Epoch 1023
Loss = 3.8828e-04, PNorm = 108.3462, GNorm = 0.0043, lr_0 = 9.4918e-04
Loss = 8.3396e-05, PNorm = 108.3469, GNorm = 0.0040, lr_0 = 9.4916e-04
Validation auc = 0.694270
Epoch 1024
Validation auc = 0.694924
Epoch 1025
Validation auc = 0.694870
Epoch 1026
Validation auc = 0.695524
Epoch 1027
Validation auc = 0.695633
Epoch 1028
Loss = 4.6587e-03, PNorm = 108.3528, GNorm = 0.2233, lr_0 = 9.4894e-04
Validation auc = 0.695361
Epoch 1029
Validation auc = 0.694979
Epoch 1030
Validation auc = 0.694107
Epoch 1031
Validation auc = 0.693453
Epoch 1032
Validation auc = 0.692907
Epoch 1033
Loss = 9.8200e-05, PNorm = 108.3643, GNorm = 0.0020, lr_0 = 9.4869e-04
Validation auc = 0.693180
Epoch 1034
Validation auc = 0.693344
Epoch 1035
Validation auc = 0.693125
Epoch 1036
Validation auc = 0.693125
Epoch 1037
Loss = 1.3875e-04, PNorm = 108.3692, GNorm = 0.0027, lr_0 = 9.4847e-04
Loss = 1.9271e-05, PNorm = 108.3695, GNorm = 0.0009, lr_0 = 9.4845e-04
Validation auc = 0.693180
Epoch 1038
Validation auc = 0.693125
Epoch 1039
Validation auc = 0.693125
Epoch 1040
Validation auc = 0.693344
Epoch 1041
Validation auc = 0.693344
Epoch 1042
Loss = 1.4356e-04, PNorm = 108.3728, GNorm = 0.0029, lr_0 = 9.4823e-04
Validation auc = 0.693180
Epoch 1043
Validation auc = 0.693344
Epoch 1044
Validation auc = 0.693507
Epoch 1045
Validation auc = 0.693562
Epoch 1046
Validation auc = 0.693453
Epoch 1047
Loss = 9.4136e-05, PNorm = 108.3764, GNorm = 0.0020, lr_0 = 9.4798e-04
Validation auc = 0.693507
Epoch 1048
Validation auc = 0.693562
Epoch 1049
Validation auc = 0.693725
Epoch 1050
Validation auc = 0.693780
Epoch 1051
Loss = 8.1835e-05, PNorm = 108.3787, GNorm = 0.0004, lr_0 = 9.4776e-04
Loss = 2.9192e-04, PNorm = 108.3789, GNorm = 0.0148, lr_0 = 9.4775e-04
Validation auc = 0.693889
Epoch 1052
Validation auc = 0.693616
Epoch 1053
Validation auc = 0.693998
Epoch 1054
Validation auc = 0.696996
Epoch 1055
Validation auc = 0.697432
Epoch 1056
Loss = 1.0533e-03, PNorm = 108.3848, GNorm = 0.0535, lr_0 = 9.4751e-04
Loss = 4.9985e-05, PNorm = 108.3864, GNorm = 0.0020, lr_0 = 9.4749e-04
Validation auc = 0.695415
Epoch 1057
Validation auc = 0.694052
Epoch 1058
Validation auc = 0.691490
Epoch 1059
Validation auc = 0.689691
Epoch 1060
Validation auc = 0.695633
Epoch 1061
Loss = 2.6619e-02, PNorm = 108.4177, GNorm = 0.7984, lr_0 = 9.4728e-04
Validation auc = 0.704628
Epoch 1062
Validation auc = 0.698686
Epoch 1063
Validation auc = 0.689255
Epoch 1064
Validation auc = 0.680096
Epoch 1065
Validation auc = 0.674372
Epoch 1066
Loss = 2.1906e-02, PNorm = 108.5363, GNorm = 1.2797, lr_0 = 9.4702e-04
Validation auc = 0.662814
Epoch 1067
Validation auc = 0.657908
Epoch 1068
Validation auc = 0.656000
Epoch 1069
Validation auc = 0.652620
Epoch 1070
Loss = 4.8948e-03, PNorm = 108.6285, GNorm = 0.3150, lr_0 = 9.4681e-04
Loss = 7.5934e-04, PNorm = 108.6356, GNorm = 0.0406, lr_0 = 9.4679e-04
Validation auc = 0.655345
Epoch 1071
Validation auc = 0.656708
Epoch 1072
Validation auc = 0.655563
Epoch 1073
Validation auc = 0.654473
Epoch 1074
Validation auc = 0.660470
Epoch 1075
Loss = 5.6172e-04, PNorm = 108.7178, GNorm = 0.0155, lr_0 = 9.4657e-04
Validation auc = 0.665376
Epoch 1076
Validation auc = 0.656272
Epoch 1077
Validation auc = 0.653546
Epoch 1078
Validation auc = 0.661778
Epoch 1079
Validation auc = 0.668811
Epoch 1080
Loss = 8.8552e-05, PNorm = 108.8237, GNorm = 0.0022, lr_0 = 9.4632e-04
Validation auc = 0.672082
Epoch 1081
Validation auc = 0.670610
Epoch 1082
Validation auc = 0.671755
Epoch 1083
Validation auc = 0.671809
Epoch 1084
Loss = 1.1106e-02, PNorm = 108.8997, GNorm = 0.0214, lr_0 = 9.4610e-04
Loss = 1.1636e-03, PNorm = 108.9045, GNorm = 0.0519, lr_0 = 9.4608e-04
Validation auc = 0.672900
Epoch 1085
Validation auc = 0.675244
Epoch 1086
Validation auc = 0.670010
Epoch 1087
Validation auc = 0.668484
Epoch 1088
Validation auc = 0.667939
Epoch 1089
Loss = 1.1749e-02, PNorm = 108.9542, GNorm = 1.0171, lr_0 = 9.4585e-04
Loss = 3.1917e-04, PNorm = 108.9584, GNorm = 0.0076, lr_0 = 9.4583e-04
Validation auc = 0.666140
Epoch 1090
Validation auc = 0.663087
Epoch 1091
Validation auc = 0.660579
Epoch 1092
Validation auc = 0.660961
Epoch 1093
Validation auc = 0.665322
Epoch 1094
Loss = 8.0353e-04, PNorm = 109.0268, GNorm = 0.0200, lr_0 = 9.4561e-04
Validation auc = 0.667884
Epoch 1095
Validation auc = 0.669411
Epoch 1096
Validation auc = 0.669847
Epoch 1097
Validation auc = 0.670665
Epoch 1098
Validation auc = 0.667721
Epoch 1099
Loss = 1.7353e-03, PNorm = 109.0947, GNorm = 0.0422, lr_0 = 9.4536e-04
Validation auc = 0.665813
Epoch 1100
Validation auc = 0.665104
Epoch 1101
Validation auc = 0.664341
Epoch 1102
Validation auc = 0.664068
Epoch 1103
Loss = 2.6559e-03, PNorm = 109.1412, GNorm = 0.1433, lr_0 = 9.4515e-04
Loss = 2.6881e-03, PNorm = 109.1491, GNorm = 0.1228, lr_0 = 9.4513e-04
Validation auc = 0.665867
Epoch 1104
Validation auc = 0.664940
Epoch 1105
Validation auc = 0.665431
Epoch 1106
Validation auc = 0.667121
Epoch 1107
Validation auc = 0.667775
Epoch 1108
Loss = 2.7165e-04, PNorm = 109.2573, GNorm = 0.0063, lr_0 = 9.4489e-04
Validation auc = 0.668756
Epoch 1109
Validation auc = 0.667285
Epoch 1110
Validation auc = 0.665431
Epoch 1111
Validation auc = 0.662705
Epoch 1112
Validation auc = 0.662760
Epoch 1113
Loss = 3.3037e-02, PNorm = 109.3324, GNorm = 0.7382, lr_0 = 9.4466e-04
Validation auc = 0.659434
Epoch 1114
Validation auc = 0.659816
Epoch 1115
Validation auc = 0.665431
Epoch 1116
Validation auc = 0.651039
Epoch 1117
Loss = 2.1063e-02, PNorm = 109.5762, GNorm = 0.3155, lr_0 = 9.4444e-04
Loss = 6.4758e-05, PNorm = 109.6052, GNorm = 0.0019, lr_0 = 9.4443e-04
Validation auc = 0.634738
Epoch 1118
Validation auc = 0.650057
Epoch 1119
Validation auc = 0.679987
Epoch 1120
Validation auc = 0.692090
Epoch 1121
Validation auc = 0.685166
Epoch 1122
Loss = 3.2629e-02, PNorm = 109.8317, GNorm = 1.1674, lr_0 = 9.4419e-04
Loss = 3.3951e-01, PNorm = 109.9071, GNorm = 12.8981, lr_0 = 9.4417e-04
Validation auc = 0.700376
Epoch 1123
Validation auc = 0.710734
Epoch 1124
Validation auc = 0.729161
Epoch 1125
Validation auc = 0.703811
Epoch 1126
Validation auc = 0.686583
Epoch 1127
Loss = 2.9736e-01, PNorm = 111.2213, GNorm = 2.5462, lr_0 = 9.4396e-04
Validation auc = 0.683803
Epoch 1128
Validation auc = 0.668375
Epoch 1129
Validation auc = 0.684130
Epoch 1130
Validation auc = 0.699286
Epoch 1131
Validation auc = 0.701412
Epoch 1132
Loss = 1.2047e-02, PNorm = 112.2365, GNorm = 0.1626, lr_0 = 9.4371e-04
Validation auc = 0.714060
Epoch 1133
Validation auc = 0.726653
Epoch 1134
Validation auc = 0.721093
Epoch 1135
Validation auc = 0.693889
Epoch 1136
Loss = 9.7073e-02, PNorm = 112.8469, GNorm = 4.7754, lr_0 = 9.4349e-04
Loss = 2.6871e-02, PNorm = 112.8990, GNorm = 1.3103, lr_0 = 9.4347e-04
Validation auc = 0.687129
Epoch 1137
Validation auc = 0.680314
Epoch 1138
Validation auc = 0.642098
Epoch 1139
Validation auc = 0.627651
Epoch 1140
Validation auc = 0.667775
Epoch 1141
Loss = 4.5667e-02, PNorm = 113.6151, GNorm = 0.9562, lr_0 = 9.4324e-04
Validation auc = 0.682495
Epoch 1142
Validation auc = 0.698959
Epoch 1143
Validation auc = 0.709971
Epoch 1144
Validation auc = 0.715968
Epoch 1145
Validation auc = 0.720384
Epoch 1146
Loss = 2.1945e-02, PNorm = 114.1467, GNorm = 0.5054, lr_0 = 9.4300e-04
Validation auc = 0.721692
Epoch 1147
Validation auc = 0.720765
Epoch 1148
Validation auc = 0.720329
Epoch 1149
Validation auc = 0.714060
Epoch 1150
Loss = 1.6828e-02, PNorm = 114.4143, GNorm = 1.0661, lr_0 = 9.4279e-04
Loss = 9.1671e-04, PNorm = 114.4268, GNorm = 0.0361, lr_0 = 9.4277e-04
Validation auc = 0.705501
Epoch 1151
Validation auc = 0.692471
Epoch 1152
Validation auc = 0.688601
Epoch 1153
Validation auc = 0.687565
Epoch 1154
Validation auc = 0.678024
Epoch 1155
Loss = 5.3045e-03, PNorm = 114.5827, GNorm = 0.5364, lr_0 = 9.4253e-04
Loss = 2.0738e-03, PNorm = 114.5926, GNorm = 0.0927, lr_0 = 9.4252e-04
Validation auc = 0.673608
Epoch 1156
Validation auc = 0.667612
Epoch 1157
Validation auc = 0.666140
Epoch 1158
Validation auc = 0.673336
Epoch 1159
Validation auc = 0.686747
Epoch 1160
Loss = 1.4010e-02, PNorm = 114.7464, GNorm = 0.3808, lr_0 = 9.4230e-04
Validation auc = 0.693289
Epoch 1161
Validation auc = 0.694052
Epoch 1162
Validation auc = 0.691272
Epoch 1163
Validation auc = 0.681459
Epoch 1164
Validation auc = 0.679660
Epoch 1165
Loss = 1.3421e-01, PNorm = 114.9707, GNorm = 3.4951, lr_0 = 9.4205e-04
Validation auc = 0.655018
Epoch 1166
Validation auc = 0.658943
Epoch 1167
Validation auc = 0.691163
Epoch 1168
Validation auc = 0.701630
Epoch 1169
Loss = 1.0320e-01, PNorm = 115.5125, GNorm = 1.3367, lr_0 = 9.4183e-04
Loss = 9.0658e-03, PNorm = 115.5618, GNorm = 0.8984, lr_0 = 9.4182e-04
Validation auc = 0.701303
Epoch 1170
Validation auc = 0.698959
Epoch 1171
Validation auc = 0.688819
Epoch 1172
Validation auc = 0.678679
Epoch 1173
Validation auc = 0.674971
Epoch 1174
Loss = 9.1605e-03, PNorm = 116.1314, GNorm = 0.2745, lr_0 = 9.4158e-04
Validation auc = 0.678188
Epoch 1175
Validation auc = 0.678460
Epoch 1176
Validation auc = 0.671537
Epoch 1177
Validation auc = 0.666521
Epoch 1178
Validation auc = 0.657090
Epoch 1179
Loss = 4.8121e-03, PNorm = 116.4630, GNorm = 0.1323, lr_0 = 9.4135e-04
Validation auc = 0.642207
Epoch 1180
Validation auc = 0.631794
Epoch 1181
Validation auc = 0.639045
Epoch 1182
Validation auc = 0.655400
Epoch 1183
Loss = 4.9020e-03, PNorm = 116.6380, GNorm = 0.0003, lr_0 = 9.4112e-04
Validation auc = 0.664232
Epoch 1184
Validation auc = 0.670065
Epoch 1185
Validation auc = 0.677806
Epoch 1186
Validation auc = 0.681350
Epoch 1187
Validation auc = 0.674099
Epoch 1188
Loss = 3.1420e-02, PNorm = 116.7724, GNorm = 1.3972, lr_0 = 9.4088e-04
Loss = 3.2221e-03, PNorm = 116.7826, GNorm = 0.1139, lr_0 = 9.4087e-04
Validation auc = 0.664940
Epoch 1189
Validation auc = 0.664722
Epoch 1190
Validation auc = 0.664722
Epoch 1191
Validation auc = 0.668811
Epoch 1192
Validation auc = 0.670501
Epoch 1193
Loss = 5.5547e-03, PNorm = 116.8937, GNorm = 0.1521, lr_0 = 9.4065e-04
Validation auc = 0.673554
Epoch 1194
Validation auc = 0.675353
Epoch 1195
Validation auc = 0.677534
Epoch 1196
Validation auc = 0.673336
Epoch 1197
Validation auc = 0.665595
Epoch 1198
Loss = 2.2667e-03, PNorm = 117.0541, GNorm = 0.0497, lr_0 = 9.4040e-04
Validation auc = 0.658943
Epoch 1199
Validation auc = 0.656708
Epoch 1200
Validation auc = 0.657799
Epoch 1201
Validation auc = 0.658126
Epoch 1202
Loss = 1.1166e-03, PNorm = 117.1472, GNorm = 0.0836, lr_0 = 9.4018e-04
Loss = 3.3655e-05, PNorm = 117.1516, GNorm = 0.0012, lr_0 = 9.4016e-04
Validation auc = 0.656763
Epoch 1203
Validation auc = 0.656763
Epoch 1204
Validation auc = 0.654800
Epoch 1205
Validation auc = 0.653219
Epoch 1206
Validation auc = 0.652729
Epoch 1207
Loss = 8.1764e-02, PNorm = 117.1898, GNorm = 0.0495, lr_0 = 9.3993e-04
Loss = 1.2338e-04, PNorm = 117.1923, GNorm = 0.0052, lr_0 = 9.3991e-04
Validation auc = 0.658834
Epoch 1208
Validation auc = 0.663468
Epoch 1209
Validation auc = 0.664504
Epoch 1210
Validation auc = 0.665867
Epoch 1211
Validation auc = 0.667775
Epoch 1212
Loss = 1.0044e-03, PNorm = 117.2502, GNorm = 0.0370, lr_0 = 9.3970e-04
Validation auc = 0.668538
Epoch 1213
Validation auc = 0.665267
Epoch 1214
Validation auc = 0.667503
Epoch 1215
Validation auc = 0.673118
Epoch 1216
Loss = 5.6579e-04, PNorm = 117.2604, GNorm = 0.0116, lr_0 = 9.3946e-04
Validation auc = 0.673281
Epoch 1217
Validation auc = 0.673990
Epoch 1218
Validation auc = 0.673717
Epoch 1219
Validation auc = 0.674862
Epoch 1220
Validation auc = 0.676552
Epoch 1221
Loss = 3.4045e-02, PNorm = 117.2689, GNorm = 1.3471, lr_0 = 9.3923e-04
Loss = 1.6888e-03, PNorm = 117.2679, GNorm = 0.0512, lr_0 = 9.3922e-04
Validation auc = 0.681023
Epoch 1222
Validation auc = 0.680369
Epoch 1223
Validation auc = 0.677098
Epoch 1224
Validation auc = 0.675353
Epoch 1225
Validation auc = 0.672355
Epoch 1226
Loss = 1.4536e-03, PNorm = 117.3203, GNorm = 0.0296, lr_0 = 9.3900e-04
Validation auc = 0.671700
Epoch 1227
Validation auc = 0.670556
Epoch 1228
Validation auc = 0.668211
Epoch 1229
Validation auc = 0.666630
Epoch 1230
Validation auc = 0.666031
Epoch 1231
Loss = 1.1636e-03, PNorm = 117.3674, GNorm = 0.0245, lr_0 = 9.3875e-04
Validation auc = 0.667121
Epoch 1232
Validation auc = 0.667012
Epoch 1233
Validation auc = 0.666467
Epoch 1234
Validation auc = 0.665595
Epoch 1235
Loss = 1.3041e-01, PNorm = 117.4117, GNorm = 2.3062, lr_0 = 9.3853e-04
Loss = 6.2807e-03, PNorm = 117.4134, GNorm = 0.2135, lr_0 = 9.3852e-04
Validation auc = 0.668320
Epoch 1236
Validation auc = 0.671864
Epoch 1237
Validation auc = 0.674099
Epoch 1238
Validation auc = 0.675953
Epoch 1239
Validation auc = 0.670937
Epoch 1240
Loss = 1.0528e-03, PNorm = 117.4518, GNorm = 0.0062, lr_0 = 9.3828e-04
Loss = 4.0576e-04, PNorm = 117.4542, GNorm = 0.0134, lr_0 = 9.3827e-04
Validation auc = 0.666358
Epoch 1241
Validation auc = 0.663850
Epoch 1242
Validation auc = 0.663087
Epoch 1243
Validation auc = 0.664286
Epoch 1244
Validation auc = 0.665485
Epoch 1245
Loss = 6.1326e-04, PNorm = 117.4993, GNorm = 0.0192, lr_0 = 9.3805e-04
Validation auc = 0.665704
Epoch 1246
Validation auc = 0.665540
Epoch 1247
Validation auc = 0.667066
Epoch 1248
Validation auc = 0.667230
Epoch 1249
Loss = 4.5464e-04, PNorm = 117.5414, GNorm = 0.0142, lr_0 = 9.3782e-04
Validation auc = 0.667175
Epoch 1250
Validation auc = 0.666794
Epoch 1251
Validation auc = 0.666903
Epoch 1252
Validation auc = 0.667012
Epoch 1253
Validation auc = 0.667721
Epoch 1254
Loss = 1.3593e-03, PNorm = 117.5634, GNorm = 0.0181, lr_0 = 9.3758e-04
Loss = 1.8040e-03, PNorm = 117.5647, GNorm = 0.1157, lr_0 = 9.3757e-04
Validation auc = 0.668756
Epoch 1255
Validation auc = 0.668375
Epoch 1256
Validation auc = 0.667939
Epoch 1257
Validation auc = 0.668320
Epoch 1258
Validation auc = 0.669683
Epoch 1259
Loss = 1.2171e-03, PNorm = 117.5851, GNorm = 0.0494, lr_0 = 9.3735e-04
Validation auc = 0.670337
Epoch 1260
Validation auc = 0.670556
Epoch 1261
Validation auc = 0.670228
Epoch 1262
Validation auc = 0.669683
Epoch 1263
Validation auc = 0.669247
Epoch 1264
Loss = 3.4567e-04, PNorm = 117.5984, GNorm = 0.0056, lr_0 = 9.3710e-04
Validation auc = 0.669247
Epoch 1265
Validation auc = 0.669629
Epoch 1266
Validation auc = 0.668102
Epoch 1267
Validation auc = 0.665213
Epoch 1268
Loss = 3.6474e-04, PNorm = 117.6067, GNorm = 0.0108, lr_0 = 9.3689e-04
Loss = 2.9399e-04, PNorm = 117.6075, GNorm = 0.0101, lr_0 = 9.3687e-04
Validation auc = 0.663032
Epoch 1269
Validation auc = 0.661669
Epoch 1270
Validation auc = 0.660961
Epoch 1271
Validation auc = 0.659652
Epoch 1272
Validation auc = 0.658289
Epoch 1273
Loss = 2.5041e-03, PNorm = 117.6190, GNorm = 0.1495, lr_0 = 9.3664e-04
Loss = 2.7032e-03, PNorm = 117.6197, GNorm = 0.1009, lr_0 = 9.3662e-04
Validation auc = 0.657144
Epoch 1274
Validation auc = 0.656763
Epoch 1275
Validation auc = 0.656545
Epoch 1276
Validation auc = 0.655945
Epoch 1277
Validation auc = 0.655727
Epoch 1278
Loss = 2.9939e-04, PNorm = 117.6284, GNorm = 0.0076, lr_0 = 9.3641e-04
Validation auc = 0.655727
Epoch 1279
Validation auc = 0.655781
Epoch 1280
Validation auc = 0.655563
Epoch 1281
Validation auc = 0.655127
Epoch 1282
Validation auc = 0.657417
Epoch 1283
Loss = 1.3292e-03, PNorm = 117.6470, GNorm = 0.0363, lr_0 = 9.3616e-04
Validation auc = 0.661996
Epoch 1284
Validation auc = 0.664504
Epoch 1285
Validation auc = 0.665158
Epoch 1286
Validation auc = 0.666848
Epoch 1287
Loss = 1.8649e-02, PNorm = 117.6987, GNorm = 0.0070, lr_0 = 9.3594e-04
Loss = 1.1073e-04, PNorm = 117.7028, GNorm = 0.0040, lr_0 = 9.3592e-04
Validation auc = 0.665922
Epoch 1288
Validation auc = 0.664395
Epoch 1289
Validation auc = 0.663632
Epoch 1290
Validation auc = 0.663414
Epoch 1291
Validation auc = 0.662869
Epoch 1292
Loss = 5.4410e-03, PNorm = 117.7393, GNorm = 0.4239, lr_0 = 9.3571e-04
Validation auc = 0.664613
Epoch 1293
Validation auc = 0.665049
Epoch 1294
Validation auc = 0.666521
Epoch 1295
Validation auc = 0.667285
Epoch 1296
Validation auc = 0.667993
Epoch 1297
Loss = 5.9235e-04, PNorm = 117.7612, GNorm = 0.0174, lr_0 = 9.3546e-04
Validation auc = 0.668429
Epoch 1298
Validation auc = 0.668593
Epoch 1299
Validation auc = 0.668702
Epoch 1300
Validation auc = 0.668866
Epoch 1301
Loss = 7.3799e-04, PNorm = 117.7692, GNorm = 0.0615, lr_0 = 9.3524e-04
Loss = 1.5986e-04, PNorm = 117.7697, GNorm = 0.0081, lr_0 = 9.3523e-04
Validation auc = 0.669193
Epoch 1302
Validation auc = 0.669356
Epoch 1303
Validation auc = 0.669193
Epoch 1304
Validation auc = 0.668920
Epoch 1305
Validation auc = 0.668756
Epoch 1306
Loss = 1.1262e-02, PNorm = 117.7758, GNorm = 0.0036, lr_0 = 9.3499e-04
Loss = 2.7396e-05, PNorm = 117.7769, GNorm = 0.0015, lr_0 = 9.3498e-04
Validation auc = 0.669847
Epoch 1307
Validation auc = 0.669901
Epoch 1308
Validation auc = 0.670174
Epoch 1309
Validation auc = 0.670392
Epoch 1310
Validation auc = 0.670828
Epoch 1311
Loss = 2.6468e-03, PNorm = 117.7919, GNorm = 0.2078, lr_0 = 9.3476e-04
Validation auc = 0.670828
Epoch 1312
Validation auc = 0.670174
Epoch 1313
Validation auc = 0.669302
Epoch 1314
Validation auc = 0.668647
Epoch 1315
Validation auc = 0.668266
Epoch 1316
Loss = 3.1868e-04, PNorm = 117.8053, GNorm = 0.0088, lr_0 = 9.3451e-04
Validation auc = 0.668320
Epoch 1317
Validation auc = 0.667830
Epoch 1318
Validation auc = 0.667830
Epoch 1319
Validation auc = 0.667721
Epoch 1320
Loss = 1.9224e-03, PNorm = 117.8148, GNorm = 0.5002, lr_0 = 9.3430e-04
Loss = 3.1392e-06, PNorm = 117.8169, GNorm = 0.0002, lr_0 = 9.3428e-04
Validation auc = 0.669138
Epoch 1321
Validation auc = 0.668375
Epoch 1322
Validation auc = 0.668484
Epoch 1323
Validation auc = 0.667884
Epoch 1324
Validation auc = 0.667175
Epoch 1325
Loss = 2.8314e-04, PNorm = 117.8423, GNorm = 0.0093, lr_0 = 9.3407e-04
Validation auc = 0.667066
Epoch 1326
Validation auc = 0.666685
Epoch 1327
Validation auc = 0.667394
Epoch 1328
Validation auc = 0.667557
Epoch 1329
Validation auc = 0.667830
Epoch 1330
Loss = 2.4255e-04, PNorm = 117.8556, GNorm = 0.0057, lr_0 = 9.3382e-04
Validation auc = 0.666140
Epoch 1331
Validation auc = 0.664341
Epoch 1332
Validation auc = 0.663795
Epoch 1333
Validation auc = 0.663468
Epoch 1334
Loss = 4.0198e-03, PNorm = 117.8626, GNorm = 0.2609, lr_0 = 9.3360e-04
Loss = 4.3274e-04, PNorm = 117.8642, GNorm = 0.0152, lr_0 = 9.3359e-04
Validation auc = 0.662651
Epoch 1335
Validation auc = 0.662269
Epoch 1336
Validation auc = 0.660852
Epoch 1337
Validation auc = 0.660852
Epoch 1338
Validation auc = 0.661179
Epoch 1339
Loss = 9.3706e-04, PNorm = 117.8853, GNorm = 0.0574, lr_0 = 9.3336e-04
Loss = 1.0737e-04, PNorm = 117.8867, GNorm = 0.0031, lr_0 = 9.3334e-04
Validation auc = 0.661615
Epoch 1340
Validation auc = 0.661015
Epoch 1341
Validation auc = 0.660306
Epoch 1342
Validation auc = 0.660088
Epoch 1343
Validation auc = 0.660197
Epoch 1344
Loss = 3.0526e-04, PNorm = 117.9070, GNorm = 0.0088, lr_0 = 9.3312e-04
Validation auc = 0.659325
Epoch 1345
Validation auc = 0.657799
Epoch 1346
Validation auc = 0.656708
Epoch 1347
Validation auc = 0.655454
Epoch 1348
Validation auc = 0.655727
Epoch 1349
Loss = 1.3666e-04, PNorm = 117.9291, GNorm = 0.0040, lr_0 = 9.3288e-04
Validation auc = 0.655236
Epoch 1350
Validation auc = 0.655127
Epoch 1351
Validation auc = 0.654855
Epoch 1352
Validation auc = 0.654637
Epoch 1353
Loss = 2.1852e-04, PNorm = 117.9412, GNorm = 0.0066, lr_0 = 9.3266e-04
Loss = 2.8240e-04, PNorm = 117.9419, GNorm = 0.0132, lr_0 = 9.3264e-04
Validation auc = 0.655182
Epoch 1354
Validation auc = 0.655618
Epoch 1355
Validation auc = 0.655945
Epoch 1356
Validation auc = 0.656109
Epoch 1357
Validation auc = 0.656490
Epoch 1358
Loss = 1.5621e-04, PNorm = 117.9488, GNorm = 0.0020, lr_0 = 9.3241e-04
Validation auc = 0.656436
Epoch 1359
Validation auc = 0.656654
Epoch 1360
Validation auc = 0.656817
Epoch 1361
Validation auc = 0.656654
Epoch 1362
Validation auc = 0.656599
Epoch 1363
Loss = 3.1727e-05, PNorm = 117.9523, GNorm = 0.0015, lr_0 = 9.3218e-04
Validation auc = 0.656490
Epoch 1364
Validation auc = 0.656708
Epoch 1365
Validation auc = 0.656817
Epoch 1366
Validation auc = 0.656926
Epoch 1367
Loss = 9.1479e-05, PNorm = 117.9540, GNorm = 0.0050, lr_0 = 9.3197e-04
Loss = 8.6623e-06, PNorm = 117.9541, GNorm = 0.0006, lr_0 = 9.3195e-04
Validation auc = 0.656872
Epoch 1368
Validation auc = 0.656981
Epoch 1369
Validation auc = 0.657035
Epoch 1370
Validation auc = 0.657308
Epoch 1371
Validation auc = 0.657362
Epoch 1372
Loss = 7.9885e-05, PNorm = 117.9565, GNorm = 0.0030, lr_0 = 9.3172e-04
Loss = 4.5050e-03, PNorm = 117.9575, GNorm = 0.1899, lr_0 = 9.3170e-04
Validation auc = 0.657690
Epoch 1373
Validation auc = 0.657417
Epoch 1374
Validation auc = 0.657908
Epoch 1375
Validation auc = 0.658180
Epoch 1376
Validation auc = 0.658071
Epoch 1377
Loss = 6.8825e-05, PNorm = 117.9670, GNorm = 0.0018, lr_0 = 9.3149e-04
Validation auc = 0.657908
Epoch 1378
Validation auc = 0.658017
Epoch 1379
Validation auc = 0.658071
Epoch 1380
Validation auc = 0.658126
Epoch 1381
Validation auc = 0.658017
Epoch 1382
Loss = 5.2220e-05, PNorm = 117.9732, GNorm = 0.0010, lr_0 = 9.3124e-04
Validation auc = 0.657799
Epoch 1383
Validation auc = 0.657744
Epoch 1384
Validation auc = 0.657690
Epoch 1385
Validation auc = 0.657690
Epoch 1386
Loss = 5.4893e-05, PNorm = 117.9778, GNorm = 0.0007, lr_0 = 9.3102e-04
Loss = 1.3411e-05, PNorm = 117.9781, GNorm = 0.0005, lr_0 = 9.3101e-04
Validation auc = 0.657799
Epoch 1387
Validation auc = 0.657744
Epoch 1388
Validation auc = 0.657853
Epoch 1389
Validation auc = 0.657690
Epoch 1390
Validation auc = 0.657799
Epoch 1391
Loss = 1.4397e-04, PNorm = 117.9808, GNorm = 0.0045, lr_0 = 9.3078e-04
Validation auc = 0.657908
Epoch 1392
Validation auc = 0.657744
Epoch 1393
Validation auc = 0.657526
Epoch 1394
Validation auc = 0.657472
Epoch 1395
Validation auc = 0.657308
Epoch 1396
Loss = 5.7617e-05, PNorm = 117.9822, GNorm = 0.0015, lr_0 = 9.3055e-04
Validation auc = 0.657199
Epoch 1397
Validation auc = 0.656981
Epoch 1398
Validation auc = 0.657090
Epoch 1399
Validation auc = 0.657253
Epoch 1400
Loss = 3.6558e-05, PNorm = 117.9839, GNorm = 0.0008, lr_0 = 9.3033e-04
Loss = 5.1657e-06, PNorm = 117.9841, GNorm = 0.0003, lr_0 = 9.3032e-04
Validation auc = 0.657308
Epoch 1401
Validation auc = 0.657581
Epoch 1402
Validation auc = 0.657635
Epoch 1403
Validation auc = 0.657635
Epoch 1404
Validation auc = 0.657908
Epoch 1405
Loss = 7.6279e-05, PNorm = 117.9863, GNorm = 0.0051, lr_0 = 9.3008e-04
Loss = 6.0369e-05, PNorm = 117.9864, GNorm = 0.0023, lr_0 = 9.3007e-04
Validation auc = 0.657908
Epoch 1406
Validation auc = 0.658289
Epoch 1407
Validation auc = 0.658453
Epoch 1408
Validation auc = 0.658780
Epoch 1409
Validation auc = 0.658943
Epoch 1410
Loss = 3.2838e-05, PNorm = 117.9885, GNorm = 0.0007, lr_0 = 9.2985e-04
Validation auc = 0.658998
Epoch 1411
Validation auc = 0.665649
Epoch 1412
Validation auc = 0.660088
Epoch 1413
Validation auc = 0.663059
Epoch 1414
Validation auc = 0.615167
Epoch 1415
Loss = 4.0258e-01, PNorm = 118.9917, GNorm = 6.6933, lr_0 = 9.2961e-04
Validation auc = 0.660961
Epoch 1416
Validation auc = 0.635556
Epoch 1417
Validation auc = 0.683803
Epoch 1418
Validation auc = 0.670228
Epoch 1419
Loss = 2.7541e-01, PNorm = 120.9958, GNorm = 1.0736, lr_0 = 9.2939e-04
Loss = 2.1664e-01, PNorm = 121.1289, GNorm = 3.9899, lr_0 = 9.2938e-04
Validation auc = 0.759418
Epoch 1420
Validation auc = 0.762089
Epoch 1421
Validation auc = 0.742136
Epoch 1422
Validation auc = 0.706428
Epoch 1423
Validation auc = 0.689909
Epoch 1424
Loss = 8.3631e-02, PNorm = 122.5666, GNorm = 1.7106, lr_0 = 9.2914e-04
Validation auc = 0.704901
Epoch 1425
Validation auc = 0.723927
Epoch 1426
Validation auc = 0.723982
Epoch 1427
Validation auc = 0.717004
Epoch 1428
Validation auc = 0.665595
Epoch 1429
Loss = 7.5245e-02, PNorm = 123.3630, GNorm = 1.0890, lr_0 = 9.2891e-04
Validation auc = 0.663741
Epoch 1430
Validation auc = 0.668484
Epoch 1431
Validation auc = 0.675898
Epoch 1432
Validation auc = 0.683967
Epoch 1433
Loss = 4.3593e-02, PNorm = 123.8601, GNorm = 0.1083, lr_0 = 9.2868e-04
Validation auc = 0.687238
Epoch 1434
Validation auc = 0.686365
Epoch 1435
Validation auc = 0.681459
Epoch 1436
Validation auc = 0.679169
Epoch 1437
Validation auc = 0.678297
Epoch 1438
Loss = 1.0260e-02, PNorm = 124.1870, GNorm = 0.6761, lr_0 = 9.2845e-04
Loss = 8.0082e-04, PNorm = 124.2056, GNorm = 0.0435, lr_0 = 9.2844e-04
Validation auc = 0.677098
Epoch 1439
Validation auc = 0.673936
Epoch 1440
Validation auc = 0.646459
Epoch 1441
Validation auc = 0.630649
Epoch 1442
Validation auc = 0.629941
Epoch 1443
Loss = 8.8927e-03, PNorm = 124.4409, GNorm = 0.2453, lr_0 = 9.2822e-04
Validation auc = 0.635665
Epoch 1444
Validation auc = 0.637627
Epoch 1445
Validation auc = 0.639099
Epoch 1446
Validation auc = 0.652729
Epoch 1447
Validation auc = 0.645096
Epoch 1448
Loss = 4.6041e-03, PNorm = 124.6984, GNorm = 0.0583, lr_0 = 9.2798e-04
Validation auc = 0.640789
Epoch 1449
Validation auc = 0.639372
Epoch 1450
Validation auc = 0.633212
Epoch 1451
Validation auc = 0.663577
Epoch 1452
Loss = 1.0172e-02, PNorm = 124.9189, GNorm = 0.0629, lr_0 = 9.2776e-04
Loss = 2.9300e-02, PNorm = 124.9387, GNorm = 1.1941, lr_0 = 9.2775e-04
Validation auc = 0.677425
Epoch 1453
Validation auc = 0.680641
Epoch 1454
Validation auc = 0.684730
Epoch 1455
Validation auc = 0.687510
Epoch 1456
Validation auc = 0.687674
Epoch 1457
Loss = 8.1080e-02, PNorm = 125.1678, GNorm = 3.6017, lr_0 = 9.2752e-04
Loss = 2.8534e-03, PNorm = 125.1849, GNorm = 0.0719, lr_0 = 9.2750e-04
Validation auc = 0.690999
Epoch 1458
Validation auc = 0.690618
Epoch 1459
Validation auc = 0.693344
Epoch 1460
Validation auc = 0.696669
Epoch 1461
Validation auc = 0.696178
Epoch 1462
Loss = 1.0268e-03, PNorm = 125.4413, GNorm = 0.0130, lr_0 = 9.2729e-04
Validation auc = 0.697868
Epoch 1463
Validation auc = 0.702448
Epoch 1464
Validation auc = 0.711552
Epoch 1465
Validation auc = 0.718803
Epoch 1466
Loss = 4.8801e-03, PNorm = 125.6606, GNorm = 0.2144, lr_0 = 9.2706e-04
Validation auc = 0.719184
Epoch 1467
Validation auc = 0.721692
Epoch 1468
Validation auc = 0.720602
Epoch 1469
Validation auc = 0.716077
Epoch 1470
Validation auc = 0.716022
Epoch 1471
Loss = 3.4598e-03, PNorm = 125.8731, GNorm = 0.0257, lr_0 = 9.2683e-04
Loss = 1.3609e-05, PNorm = 125.8843, GNorm = 0.0009, lr_0 = 9.2681e-04
Validation auc = 0.723764
Epoch 1472
Validation auc = 0.727198
Epoch 1473
Validation auc = 0.725236
Epoch 1474
Validation auc = 0.720220
Epoch 1475
Validation auc = 0.715804
Epoch 1476
Loss = 2.0860e-01, PNorm = 125.9965, GNorm = 1.4805, lr_0 = 9.2660e-04
Validation auc = 0.720547
Epoch 1477
Validation auc = 0.719512
Epoch 1478
Validation auc = 0.716786
Epoch 1479
Validation auc = 0.711334
Epoch 1480
Validation auc = 0.706100
Epoch 1481
Loss = 1.6831e-02, PNorm = 126.1431, GNorm = 0.4184, lr_0 = 9.2635e-04
Validation auc = 0.698250
Epoch 1482
Validation auc = 0.690127
Epoch 1483
Validation auc = 0.684294
Epoch 1484
Validation auc = 0.680587
Epoch 1485
Loss = 6.5658e-02, PNorm = 126.3348, GNorm = 2.2437, lr_0 = 9.2614e-04
Loss = 3.0966e-03, PNorm = 126.3453, GNorm = 0.1354, lr_0 = 9.2612e-04
Validation auc = 0.661070
Epoch 1486
Validation auc = 0.647113
Epoch 1487
Validation auc = 0.649512
Epoch 1488
Validation auc = 0.653546
Epoch 1489
Validation auc = 0.659870
Epoch 1490
Loss = 1.0514e-02, PNorm = 126.4801, GNorm = 0.2391, lr_0 = 9.2589e-04
Loss = 7.1740e-03, PNorm = 126.4893, GNorm = 0.2113, lr_0 = 9.2587e-04
Validation auc = 0.665104
Epoch 1491
Validation auc = 0.664123
Epoch 1492
Validation auc = 0.665213
Epoch 1493
Validation auc = 0.666194
Epoch 1494
Validation auc = 0.668866
Epoch 1495
Loss = 1.8382e-02, PNorm = 126.5935, GNorm = 0.6636, lr_0 = 9.2566e-04
Validation auc = 0.673608
Epoch 1496
Validation auc = 0.678406
Epoch 1497
Validation auc = 0.680314
Epoch 1498
Validation auc = 0.680914
Epoch 1499
Loss = 9.3596e-03, PNorm = 126.6719, GNorm = 0.5172, lr_0 = 9.2543e-04
Validation auc = 0.679496
Epoch 1500
Validation auc = 0.678679
Epoch 1501
Validation auc = 0.675353
Epoch 1502
Validation auc = 0.670337
Epoch 1503
Validation auc = 0.664014
Epoch 1504
Loss = 1.9055e-02, PNorm = 126.8384, GNorm = 0.1446, lr_0 = 9.2520e-04
Loss = 8.2871e-03, PNorm = 126.8524, GNorm = 0.3729, lr_0 = 9.2518e-04
Validation auc = 0.658398
Epoch 1505
Validation auc = 0.655236
Epoch 1506
Validation auc = 0.654473
Epoch 1507
Validation auc = 0.653328
Epoch 1508
Validation auc = 0.653492
Epoch 1509
Loss = 6.2881e-03, PNorm = 126.9864, GNorm = 0.0862, lr_0 = 9.2497e-04
Validation auc = 0.653219
Epoch 1510
Validation auc = 0.654091
Epoch 1511
Validation auc = 0.653601
Epoch 1512
Validation auc = 0.653655
Epoch 1513
Validation auc = 0.653982
Epoch 1514
Loss = 7.1068e-04, PNorm = 127.0996, GNorm = 0.0105, lr_0 = 9.2472e-04
Validation auc = 0.655182
Epoch 1515
Validation auc = 0.656981
Epoch 1516
Validation auc = 0.659271
Epoch 1517
Validation auc = 0.661124
Epoch 1518
Loss = 1.9225e-03, PNorm = 127.1722, GNorm = 0.0348, lr_0 = 9.2451e-04
Loss = 5.5252e-04, PNorm = 127.1771, GNorm = 0.0199, lr_0 = 9.2449e-04
Validation auc = 0.662269
Epoch 1519
Validation auc = 0.662869
Epoch 1520
Validation auc = 0.663904
Epoch 1521
Validation auc = 0.665976
Epoch 1522
Validation auc = 0.666685
Epoch 1523
Loss = 2.8065e-03, PNorm = 127.2251, GNorm = 0.0206, lr_0 = 9.2427e-04
Loss = 3.7521e-04, PNorm = 127.2278, GNorm = 0.0181, lr_0 = 9.2425e-04
Validation auc = 0.666467
Epoch 1524
Validation auc = 0.666794
Epoch 1525
Validation auc = 0.667012
Epoch 1526
Validation auc = 0.667175
Epoch 1527
Validation auc = 0.666630
Epoch 1528
Loss = 6.2574e-04, PNorm = 127.2548, GNorm = 0.0153, lr_0 = 9.2404e-04
Validation auc = 0.666794
Epoch 1529
Validation auc = 0.666794
Epoch 1530
Validation auc = 0.666957
Epoch 1531
Validation auc = 0.667230
Epoch 1532
Validation auc = 0.666903
Epoch 1533
Loss = 7.3767e-04, PNorm = 127.2732, GNorm = 0.0228, lr_0 = 9.2379e-04
Validation auc = 0.666848
Epoch 1534
Validation auc = 0.667721
Epoch 1535
Validation auc = 0.668102
Epoch 1536
Validation auc = 0.668375
Epoch 1537
Loss = 1.7537e-02, PNorm = 127.2861, GNorm = 0.0995, lr_0 = 9.2358e-04
Loss = 1.4793e-04, PNorm = 127.2873, GNorm = 0.0043, lr_0 = 9.2356e-04
Validation auc = 0.666521
Epoch 1538
Validation auc = 0.665595
Epoch 1539
Validation auc = 0.664886
Epoch 1540
Validation auc = 0.665485
Epoch 1541
Validation auc = 0.665267
Epoch 1542
Loss = 1.3708e-03, PNorm = 127.3097, GNorm = 0.0276, lr_0 = 9.2335e-04
Validation auc = 0.670610
Epoch 1543
Validation auc = 0.674590
Epoch 1544
Validation auc = 0.679987
Epoch 1545
Validation auc = 0.684675
Epoch 1546
Validation auc = 0.689364
Epoch 1547
Loss = 8.2104e-03, PNorm = 127.4007, GNorm = 0.2100, lr_0 = 9.2310e-04
Validation auc = 0.694216
Epoch 1548
Validation auc = 0.697378
Epoch 1549
Validation auc = 0.697759
Epoch 1550
Validation auc = 0.698305
Epoch 1551
Loss = 4.2816e-02, PNorm = 127.4712, GNorm = 0.0140, lr_0 = 9.2289e-04
Loss = 1.5757e-02, PNorm = 127.4802, GNorm = 0.6531, lr_0 = 9.2287e-04
Validation auc = 0.686147
Epoch 1552
Validation auc = 0.679987
Epoch 1553
Validation auc = 0.677370
Epoch 1554
Validation auc = 0.677425
Epoch 1555
Validation auc = 0.677806
Epoch 1556
Loss = 7.1895e-04, PNorm = 127.6553, GNorm = 0.0089, lr_0 = 9.2264e-04
Loss = 6.5494e-04, PNorm = 127.6644, GNorm = 0.0121, lr_0 = 9.2263e-04
Validation auc = 0.678133
Epoch 1557
Validation auc = 0.679387
Epoch 1558
Validation auc = 0.679932
Epoch 1559
Validation auc = 0.680750
Epoch 1560
Validation auc = 0.681622
Epoch 1561
Loss = 3.3253e-04, PNorm = 127.7348, GNorm = 0.0126, lr_0 = 9.2242e-04
Validation auc = 0.682059
Epoch 1562
Validation auc = 0.679660
Epoch 1563
Validation auc = 0.676225
Epoch 1564
Validation auc = 0.672191
Epoch 1565
Validation auc = 0.664395
Epoch 1566
Loss = 7.3050e-03, PNorm = 127.7737, GNorm = 0.3101, lr_0 = 9.2217e-04
Validation auc = 0.660034
Epoch 1567
Validation auc = 0.662160
Epoch 1568
Validation auc = 0.663632
Epoch 1569
Validation auc = 0.665922
Epoch 1570
Loss = 4.5791e-03, PNorm = 127.8279, GNorm = 0.0067, lr_0 = 9.2196e-04
Loss = 1.9116e-03, PNorm = 127.8314, GNorm = 0.0980, lr_0 = 9.2194e-04
Validation auc = 0.667012
Epoch 1571
Validation auc = 0.667285
Epoch 1572
Validation auc = 0.667448
Epoch 1573
Validation auc = 0.667666
Epoch 1574
Validation auc = 0.668320
Epoch 1575
Loss = 3.6698e-04, PNorm = 127.8658, GNorm = 0.0057, lr_0 = 9.2173e-04
Validation auc = 0.667830
Epoch 1576
Validation auc = 0.667557
Epoch 1577
Validation auc = 0.667830
Epoch 1578
Validation auc = 0.667884
Epoch 1579
Validation auc = 0.667775
Epoch 1580
Loss = 5.3067e-03, PNorm = 127.8812, GNorm = 0.2026, lr_0 = 9.2148e-04
Validation auc = 0.668538
Epoch 1581
Validation auc = 0.668484
Epoch 1582
Validation auc = 0.668048
Epoch 1583
Validation auc = 0.667993
Epoch 1584
Loss = 2.2331e-03, PNorm = 127.9088, GNorm = 0.0667, lr_0 = 9.2127e-04
Loss = 6.1356e-04, PNorm = 127.9119, GNorm = 0.0225, lr_0 = 9.2125e-04
Validation auc = 0.667230
Epoch 1585
Validation auc = 0.667939
Epoch 1586
Validation auc = 0.672027
Epoch 1587
Validation auc = 0.670883
Epoch 1588
Validation auc = 0.670719
Epoch 1589
Loss = 1.1683e-03, PNorm = 127.9839, GNorm = 0.0399, lr_0 = 9.2103e-04
Loss = 3.4375e-04, PNorm = 127.9901, GNorm = 0.0121, lr_0 = 9.2101e-04
Validation auc = 0.670610
Epoch 1590
Validation auc = 0.670065
Epoch 1591
Validation auc = 0.669847
Epoch 1592
Validation auc = 0.669574
Epoch 1593
Validation auc = 0.669084
Epoch 1594
Loss = 6.4464e-05, PNorm = 128.0416, GNorm = 0.0014, lr_0 = 9.2080e-04
Validation auc = 0.668920
Epoch 1595
Validation auc = 0.668811
Epoch 1596
Validation auc = 0.668429
Epoch 1597
Validation auc = 0.671046
Epoch 1598
Validation auc = 0.673499
Epoch 1599
Loss = 1.0995e-03, PNorm = 128.0637, GNorm = 0.0742, lr_0 = 9.2055e-04
Validation auc = 0.675353
Epoch 1600
Validation auc = 0.675953
Epoch 1601
Validation auc = 0.675898
Epoch 1602
Validation auc = 0.675844
Epoch 1603
Loss = 3.9021e-03, PNorm = 128.0897, GNorm = 0.0090, lr_0 = 9.2034e-04
Loss = 1.1742e-04, PNorm = 128.0913, GNorm = 0.0038, lr_0 = 9.2032e-04
Validation auc = 0.675517
Epoch 1604
Validation auc = 0.675244
Epoch 1605
Validation auc = 0.674862
Epoch 1606
Validation auc = 0.674535
Epoch 1607
Validation auc = 0.674154
Epoch 1608
Loss = 4.9043e-04, PNorm = 128.1060, GNorm = 0.0115, lr_0 = 9.2010e-04
Validation auc = 0.673827
Epoch 1609
Validation auc = 0.673663
Epoch 1610
Validation auc = 0.673554
Epoch 1611
Validation auc = 0.673608
Epoch 1612
Validation auc = 0.673608
Epoch 1613
Loss = 1.7115e-02, PNorm = 128.1151, GNorm = 0.6614, lr_0 = 9.1987e-04
Validation auc = 0.674644
Epoch 1614
Validation auc = 0.675298
Epoch 1615
Validation auc = 0.675680
Epoch 1616
Validation auc = 0.676225
Epoch 1617
Loss = 1.2927e-03, PNorm = 128.1302, GNorm = 0.0795, lr_0 = 9.1966e-04
Loss = 8.4787e-05, PNorm = 128.1313, GNorm = 0.0028, lr_0 = 9.1964e-04
Validation auc = 0.676007
Epoch 1618
Validation auc = 0.674917
Epoch 1619
Validation auc = 0.674317
Epoch 1620
Validation auc = 0.673772
Epoch 1621
Validation auc = 0.673336
Epoch 1622
Loss = 1.4345e-04, PNorm = 128.1435, GNorm = 0.0032, lr_0 = 9.1941e-04
Loss = 2.9801e-05, PNorm = 128.1441, GNorm = 0.0012, lr_0 = 9.1939e-04
Validation auc = 0.673063
Epoch 1623
Validation auc = 0.672900
Epoch 1624
Validation auc = 0.672736
Epoch 1625
Validation auc = 0.672518
Epoch 1626
Validation auc = 0.672355
Epoch 1627
Loss = 1.7363e-04, PNorm = 128.1503, GNorm = 0.0040, lr_0 = 9.1918e-04
Validation auc = 0.672409
Epoch 1628
Validation auc = 0.672682
Epoch 1629
Validation auc = 0.672518
Epoch 1630
Validation auc = 0.672464
Epoch 1631
Validation auc = 0.672627
Epoch 1632
Loss = 8.8940e-05, PNorm = 128.1506, GNorm = 0.0021, lr_0 = 9.1894e-04
Validation auc = 0.672300
Epoch 1633
Validation auc = 0.672191
Epoch 1634
Validation auc = 0.672464
Epoch 1635
Validation auc = 0.670501
Epoch 1636
Loss = 1.8793e-04, PNorm = 128.1530, GNorm = 0.0042, lr_0 = 9.1873e-04
Loss = 1.7286e-04, PNorm = 128.1537, GNorm = 0.0064, lr_0 = 9.1871e-04
Validation auc = 0.667993
Epoch 1637
Validation auc = 0.665649
Epoch 1638
Validation auc = 0.664613
Epoch 1639
Validation auc = 0.664123
Epoch 1640
Validation auc = 0.663577
Epoch 1641
Loss = 4.0513e-04, PNorm = 128.1674, GNorm = 0.0053, lr_0 = 9.1848e-04
Validation auc = 0.663359
Epoch 1642
Validation auc = 0.663087
Epoch 1643
Validation auc = 0.662760
Epoch 1644
Validation auc = 0.662869
Epoch 1645
Validation auc = 0.662978
Epoch 1646
Loss = 2.7792e-02, PNorm = 128.1785, GNorm = 0.7271, lr_0 = 9.1825e-04
Validation auc = 0.661615
Epoch 1647
Validation auc = 0.661506
Epoch 1648
Validation auc = 0.660688
Epoch 1649
Validation auc = 0.659598
Epoch 1650
Loss = 7.8504e-04, PNorm = 128.1926, GNorm = 0.0103, lr_0 = 9.1804e-04
Loss = 1.2711e-03, PNorm = 128.1940, GNorm = 0.0507, lr_0 = 9.1803e-04
Validation auc = 0.659434
Epoch 1651
Validation auc = 0.659543
Epoch 1652
Validation auc = 0.659434
Epoch 1653
Validation auc = 0.659652
Epoch 1654
Validation auc = 0.659652
Epoch 1655
Loss = 2.6177e-04, PNorm = 128.2136, GNorm = 0.0047, lr_0 = 9.1780e-04
Loss = 3.2364e-04, PNorm = 128.2146, GNorm = 0.0091, lr_0 = 9.1778e-04
Validation auc = 0.659816
Epoch 1656
Validation auc = 0.659979
Epoch 1657
Validation auc = 0.661179
Epoch 1658
Validation auc = 0.662105
Epoch 1659
Validation auc = 0.663032
Epoch 1660
Loss = 6.3690e-05, PNorm = 128.2248, GNorm = 0.0012, lr_0 = 9.1757e-04
Validation auc = 0.663632
Epoch 1661
Validation auc = 0.663959
Epoch 1662
Validation auc = 0.664613
Epoch 1663
Validation auc = 0.665758
Epoch 1664
Validation auc = 0.666467
Epoch 1665
Loss = 1.0553e-04, PNorm = 128.2328, GNorm = 0.0026, lr_0 = 9.1733e-04
Validation auc = 0.666685
Epoch 1666
Validation auc = 0.667175
Epoch 1667
Validation auc = 0.666848
Epoch 1668
Validation auc = 0.667175
Epoch 1669
Loss = 6.3798e-04, PNorm = 128.2424, GNorm = 0.0179, lr_0 = 9.1712e-04
Loss = 1.3190e-04, PNorm = 128.2434, GNorm = 0.0064, lr_0 = 9.1710e-04
Validation auc = 0.667175
Epoch 1670
Validation auc = 0.667394
Epoch 1671
Validation auc = 0.667230
Epoch 1672
Validation auc = 0.667557
Epoch 1673
Validation auc = 0.667503
Epoch 1674
Loss = 8.9201e-05, PNorm = 128.2540, GNorm = 0.0015, lr_0 = 9.1687e-04
Validation auc = 0.667448
Epoch 1675
Validation auc = 0.667557
Epoch 1676
Validation auc = 0.667503
Epoch 1677
Validation auc = 0.667721
Epoch 1678
Validation auc = 0.667666
Epoch 1679
Loss = 5.8841e-05, PNorm = 128.2586, GNorm = 0.0014, lr_0 = 9.1664e-04
Validation auc = 0.667939
Epoch 1680
Validation auc = 0.667993
Epoch 1681
Validation auc = 0.668157
Epoch 1682
Validation auc = 0.668211
Epoch 1683
Loss = 8.2190e-05, PNorm = 128.2617, GNorm = 0.0030, lr_0 = 9.1642e-04
Validation auc = 0.668320
Epoch 1684
Validation auc = 0.668375
Epoch 1685
Validation auc = 0.668320
Epoch 1686
Validation auc = 0.668266
Epoch 1687
Validation auc = 0.668320
Epoch 1688
Loss = 1.6994e-04, PNorm = 128.2645, GNorm = 0.0152, lr_0 = 9.1619e-04
Loss = 2.5271e-05, PNorm = 128.2648, GNorm = 0.0009, lr_0 = 9.1617e-04
Validation auc = 0.668320
Epoch 1689
Validation auc = 0.668375
Epoch 1690
Validation auc = 0.668593
Epoch 1691
Validation auc = 0.668593
Epoch 1692
Validation auc = 0.668975
Epoch 1693
Loss = 1.0729e-04, PNorm = 128.2674, GNorm = 0.0043, lr_0 = 9.1596e-04
Validation auc = 0.669193
Epoch 1694
Validation auc = 0.669247
Epoch 1695
Validation auc = 0.669084
Epoch 1696
Validation auc = 0.669084
Epoch 1697
Validation auc = 0.669247
Epoch 1698
Loss = 1.3590e-02, PNorm = 128.2703, GNorm = 0.5062, lr_0 = 9.1572e-04
Validation auc = 0.667721
Epoch 1699
Validation auc = 0.666140
Epoch 1700
Validation auc = 0.665922
Epoch 1701
Validation auc = 0.665704
Epoch 1702
Loss = 1.7653e-04, PNorm = 128.2816, GNorm = 0.0092, lr_0 = 9.1551e-04
Loss = 1.1345e-04, PNorm = 128.2825, GNorm = 0.0041, lr_0 = 9.1549e-04
Validation auc = 0.665649
Epoch 1703
Validation auc = 0.665485
Epoch 1704
Validation auc = 0.665540
Epoch 1705
Validation auc = 0.665158
Epoch 1706
Validation auc = 0.664395
Epoch 1707
Loss = 1.2396e-04, PNorm = 128.2942, GNorm = 0.0040, lr_0 = 9.1526e-04
Loss = 5.3937e-05, PNorm = 128.2949, GNorm = 0.0019, lr_0 = 9.1525e-04
Validation auc = 0.664395
Epoch 1708
Validation auc = 0.664341
Epoch 1709
Validation auc = 0.664777
Epoch 1710
Validation auc = 0.664613
Epoch 1711
Validation auc = 0.664777
Epoch 1712
Loss = 4.7225e-05, PNorm = 128.3016, GNorm = 0.0011, lr_0 = 9.1504e-04
Validation auc = 0.664668
Epoch 1713
Validation auc = 0.664613
Epoch 1714
Validation auc = 0.664722
Epoch 1715
Validation auc = 0.664831
Epoch 1716
Loss = 4.0012e-05, PNorm = 128.3058, GNorm = 0.0003, lr_0 = 9.1481e-04
Validation auc = 0.664668
Epoch 1717
Validation auc = 0.664613
Epoch 1718
Validation auc = 0.664668
Epoch 1719
Validation auc = 0.664777
Epoch 1720
Validation auc = 0.664831
Epoch 1721
Loss = 3.0884e-04, PNorm = 128.3082, GNorm = 0.0266, lr_0 = 9.1458e-04
Loss = 4.3908e-06, PNorm = 128.3083, GNorm = 0.0002, lr_0 = 9.1457e-04
Validation auc = 0.664668
Epoch 1722
Validation auc = 0.664613
Epoch 1723
Validation auc = 0.664777
Epoch 1724
Validation auc = 0.664886
Epoch 1725
Validation auc = 0.664777
Epoch 1726
Loss = 2.5886e-05, PNorm = 128.3094, GNorm = 0.0005, lr_0 = 9.1436e-04
Validation auc = 0.664722
Epoch 1727
Validation auc = 0.664722
Epoch 1728
Validation auc = 0.664668
Epoch 1729
Validation auc = 0.664777
Epoch 1730
Validation auc = 0.664777
Epoch 1731
Loss = 2.2367e-04, PNorm = 128.3112, GNorm = 0.0192, lr_0 = 9.1411e-04
Validation auc = 0.664995
Epoch 1732
Validation auc = 0.664886
Epoch 1733
Validation auc = 0.664886
Epoch 1734
Validation auc = 0.664940
Epoch 1735
Loss = 8.1310e-05, PNorm = 128.3137, GNorm = 0.0052, lr_0 = 9.1390e-04
Loss = 9.0795e-06, PNorm = 128.3138, GNorm = 0.0004, lr_0 = 9.1389e-04
Validation auc = 0.664995
Epoch 1736
Validation auc = 0.665104
Epoch 1737
Validation auc = 0.664831
Epoch 1738
Validation auc = 0.665049
Epoch 1739
Validation auc = 0.665158
Epoch 1740
Loss = 3.8356e-05, PNorm = 128.3163, GNorm = 0.0015, lr_0 = 9.1366e-04
Loss = 8.5035e-06, PNorm = 128.3164, GNorm = 0.0003, lr_0 = 9.1364e-04
Validation auc = 0.665376
Epoch 1741
Validation auc = 0.665485
Epoch 1742
Validation auc = 0.665758
Epoch 1743
Validation auc = 0.665813
Epoch 1744
Validation auc = 0.665649
Epoch 1745
Loss = 2.3173e-05, PNorm = 128.3183, GNorm = 0.0005, lr_0 = 9.1343e-04
Validation auc = 0.665485
Epoch 1746
Validation auc = 0.665431
Epoch 1747
Validation auc = 0.665376
Epoch 1748
Validation auc = 0.665322
Epoch 1749
Loss = 2.7008e-05, PNorm = 128.3200, GNorm = 0.0007, lr_0 = 9.1320e-04
Validation auc = 0.665376
Epoch 1750
Validation auc = 0.665322
Epoch 1751
Validation auc = 0.665322
Epoch 1752
Validation auc = 0.665376
Epoch 1753
Validation auc = 0.665322
Epoch 1754
Loss = 2.8343e-05, PNorm = 128.3213, GNorm = 0.0004, lr_0 = 9.1298e-04
Loss = 4.2910e-05, PNorm = 128.3214, GNorm = 0.0024, lr_0 = 9.1296e-04
Validation auc = 0.665431
Epoch 1755
Validation auc = 0.665540
Epoch 1756
Validation auc = 0.665485
Epoch 1757
Validation auc = 0.665485
Epoch 1758
Validation auc = 0.665431
Epoch 1759
Loss = 2.8517e-05, PNorm = 128.3225, GNorm = 0.0005, lr_0 = 9.1275e-04
Validation auc = 0.665595
Epoch 1760
Validation auc = 0.665540
Epoch 1761
Validation auc = 0.665485
Epoch 1762
Validation auc = 0.665649
Epoch 1763
Validation auc = 0.665595
Epoch 1764
Loss = 3.4298e-05, PNorm = 128.3240, GNorm = 0.0008, lr_0 = 9.1251e-04
Validation auc = 0.665976
Epoch 1765
Validation auc = 0.666739
Epoch 1766
Validation auc = 0.667557
Epoch 1767
Validation auc = 0.667939
Epoch 1768
Loss = 3.7994e-05, PNorm = 128.3257, GNorm = 0.0010, lr_0 = 9.1230e-04
Loss = 1.0624e-04, PNorm = 128.3261, GNorm = 0.0042, lr_0 = 9.1228e-04
Validation auc = 0.668593
Epoch 1769
Validation auc = 0.668702
Epoch 1770
Validation auc = 0.669084
Epoch 1771
Validation auc = 0.669138
Epoch 1772
Validation auc = 0.668920
Epoch 1773
Loss = 4.1556e-05, PNorm = 128.3313, GNorm = 0.0015, lr_0 = 9.1206e-04
Loss = 6.8743e-06, PNorm = 128.3315, GNorm = 0.0004, lr_0 = 9.1204e-04
Validation auc = 0.668647
Epoch 1774
Validation auc = 0.668811
Epoch 1775
Validation auc = 0.669084
Epoch 1776
Validation auc = 0.668975
Epoch 1777
Validation auc = 0.669029
Epoch 1778
Loss = 1.7497e-05, PNorm = 128.3338, GNorm = 0.0005, lr_0 = 9.1183e-04
Validation auc = 0.669138
Epoch 1779
Validation auc = 0.669138
Epoch 1780
Validation auc = 0.669084
Epoch 1781
Validation auc = 0.669084
Epoch 1782
Validation auc = 0.668975
Epoch 1783
Loss = 5.4890e-05, PNorm = 128.3359, GNorm = 0.0029, lr_0 = 9.1159e-04
Validation auc = 0.668866
Epoch 1784
Validation auc = 0.668866
Epoch 1785
Validation auc = 0.668756
Epoch 1786
Validation auc = 0.668756
Epoch 1787
Loss = 5.3580e-05, PNorm = 128.3377, GNorm = 0.0011, lr_0 = 9.1138e-04
Loss = 4.9068e-05, PNorm = 128.3379, GNorm = 0.0018, lr_0 = 9.1136e-04
Validation auc = 0.668593
Epoch 1788
Validation auc = 0.668484
Epoch 1789
Validation auc = 0.668375
Epoch 1790
Validation auc = 0.668375
Epoch 1791
Validation auc = 0.668375
Epoch 1792
Loss = 2.0202e-05, PNorm = 128.3396, GNorm = 0.0004, lr_0 = 9.1115e-04
Validation auc = 0.668429
Epoch 1793
Validation auc = 0.668320
Epoch 1794
Validation auc = 0.668320
Epoch 1795
Validation auc = 0.668266
Epoch 1796
Validation auc = 0.668102
Epoch 1797
Loss = 4.0794e-05, PNorm = 128.3412, GNorm = 0.0008, lr_0 = 9.1091e-04
Validation auc = 0.668157
Epoch 1798
Validation auc = 0.668266
Epoch 1799
Validation auc = 0.668211
Epoch 1800
Validation auc = 0.667721
Epoch 1801
Loss = 3.6246e-05, PNorm = 128.3422, GNorm = 0.0013, lr_0 = 9.1070e-04
Loss = 2.8014e-06, PNorm = 128.3422, GNorm = 0.0001, lr_0 = 9.1068e-04
Validation auc = 0.667394
Epoch 1802
Validation auc = 0.667557
Epoch 1803
Validation auc = 0.667121
Epoch 1804
Validation auc = 0.667230
Epoch 1805
Validation auc = 0.667448
Epoch 1806
Loss = 2.2084e-05, PNorm = 128.3439, GNorm = 0.0005, lr_0 = 9.1046e-04
Loss = 2.2608e-05, PNorm = 128.3440, GNorm = 0.0011, lr_0 = 9.1044e-04
Validation auc = 0.667448
Epoch 1807
Validation auc = 0.667503
Epoch 1808
Validation auc = 0.667394
Epoch 1809
Validation auc = 0.667175
Epoch 1810
Validation auc = 0.667285
Epoch 1811
Loss = 1.3713e-05, PNorm = 128.3469, GNorm = 0.0004, lr_0 = 9.1023e-04
Validation auc = 0.667339
Epoch 1812
Validation auc = 0.667230
Epoch 1813
Validation auc = 0.667230
Epoch 1814
Validation auc = 0.667230
Epoch 1815
Validation auc = 0.667175
Epoch 1816
Loss = 1.2323e-05, PNorm = 128.3492, GNorm = 0.0003, lr_0 = 9.0999e-04
Validation auc = 0.667339
Epoch 1817
Validation auc = 0.667666
Epoch 1818
Validation auc = 0.667721
Epoch 1819
Validation auc = 0.667557
Epoch 1820
Loss = 2.1202e-05, PNorm = 128.3504, GNorm = 0.0005, lr_0 = 9.0978e-04
Loss = 2.1556e-05, PNorm = 128.3505, GNorm = 0.0009, lr_0 = 9.0976e-04
Validation auc = 0.667666
Epoch 1821
Validation auc = 0.667775
Epoch 1822
Validation auc = 0.667830
Epoch 1823
Validation auc = 0.667884
Epoch 1824
Validation auc = 0.667775
Epoch 1825
Loss = 2.1907e-05, PNorm = 128.3523, GNorm = 0.0008, lr_0 = 9.0955e-04
Validation auc = 0.667775
Epoch 1826
Validation auc = 0.667775
Epoch 1827
Validation auc = 0.667830
Epoch 1828
Validation auc = 0.667830
Epoch 1829
Validation auc = 0.667775
Epoch 1830
Loss = 1.2693e-05, PNorm = 128.3541, GNorm = 0.0003, lr_0 = 9.0931e-04
Validation auc = 0.667557
Epoch 1831
Validation auc = 0.667557
Epoch 1832
Validation auc = 0.667339
Epoch 1833
Validation auc = 0.667448
Epoch 1834
Loss = 6.1307e-05, PNorm = 128.3559, GNorm = 0.0003, lr_0 = 9.0910e-04
Loss = 2.4636e-06, PNorm = 128.3560, GNorm = 0.0001, lr_0 = 9.0909e-04
Validation auc = 0.667448
Epoch 1835
Validation auc = 0.667557
Epoch 1836
Validation auc = 0.667557
Epoch 1837
Validation auc = 0.667503
Epoch 1838
Validation auc = 0.667503
Epoch 1839
Loss = 1.9932e-05, PNorm = 128.3573, GNorm = 0.0004, lr_0 = 9.0886e-04
Loss = 1.7166e-05, PNorm = 128.3573, GNorm = 0.0006, lr_0 = 9.0884e-04
Validation auc = 0.667448
Epoch 1840
Validation auc = 0.667612
Epoch 1841
Validation auc = 0.667394
Epoch 1842
Validation auc = 0.667448
Epoch 1843
Validation auc = 0.667557
Epoch 1844
Loss = 1.5761e-05, PNorm = 128.3583, GNorm = 0.0004, lr_0 = 9.0863e-04
Validation auc = 0.667612
Epoch 1845
Validation auc = 0.667557
Epoch 1846
Validation auc = 0.667557
Epoch 1847
Validation auc = 0.667666
Epoch 1848
Validation auc = 0.667612
Epoch 1849
Loss = 9.9822e-06, PNorm = 128.3595, GNorm = 0.0003, lr_0 = 9.0839e-04
Validation auc = 0.667666
Epoch 1850
Validation auc = 0.667612
Epoch 1851
Validation auc = 0.667612
Epoch 1852
Validation auc = 0.667557
Epoch 1853
Loss = 2.5300e-05, PNorm = 128.3605, GNorm = 0.0010, lr_0 = 9.0818e-04
Loss = 7.5299e-06, PNorm = 128.3605, GNorm = 0.0004, lr_0 = 9.0817e-04
Validation auc = 0.667448
Epoch 1854
Validation auc = 0.667394
Epoch 1855
Validation auc = 0.667612
Epoch 1856
Validation auc = 0.667721
Epoch 1857
Validation auc = 0.667721
Epoch 1858
Loss = 3.2977e-05, PNorm = 128.3610, GNorm = 0.0018, lr_0 = 9.0794e-04
Validation auc = 0.667666
Epoch 1859
Validation auc = 0.667721
Epoch 1860
Validation auc = 0.667721
Epoch 1861
Validation auc = 0.667721
Epoch 1862
Validation auc = 0.667830
Epoch 1863
Loss = 7.7412e-06, PNorm = 128.3619, GNorm = 0.0002, lr_0 = 9.0772e-04
Validation auc = 0.667830
Epoch 1864
Validation auc = 0.667830
Epoch 1865
Validation auc = 0.667884
Epoch 1866
Validation auc = 0.667884
Epoch 1867
Loss = 8.2908e-06, PNorm = 128.3630, GNorm = 0.0002, lr_0 = 9.0751e-04
Loss = 7.9472e-06, PNorm = 128.3631, GNorm = 0.0004, lr_0 = 9.0749e-04
Validation auc = 0.667721
Epoch 1868
Validation auc = 0.667721
Epoch 1869
Validation auc = 0.667666
Epoch 1870
Validation auc = 0.667666
Epoch 1871
Validation auc = 0.667666
Epoch 1872
Loss = 1.0827e-05, PNorm = 128.3643, GNorm = 0.0002, lr_0 = 9.0727e-04
Loss = 1.5895e-06, PNorm = 128.3644, GNorm = 0.0001, lr_0 = 9.0725e-04
Validation auc = 0.667721
Epoch 1873
Validation auc = 0.667612
Epoch 1874
Validation auc = 0.667557
Epoch 1875
Validation auc = 0.667612
Epoch 1876
Validation auc = 0.667612
Epoch 1877
Loss = 1.0464e-05, PNorm = 128.3653, GNorm = 0.0003, lr_0 = 9.0704e-04
Validation auc = 0.667557
Epoch 1878
Validation auc = 0.667503
Epoch 1879
Validation auc = 0.667612
Epoch 1880
Validation auc = 0.667666
Epoch 1881
Validation auc = 0.667666
Epoch 1882
Loss = 6.8329e-06, PNorm = 128.3663, GNorm = 0.0002, lr_0 = 9.0680e-04
Validation auc = 0.667557
Epoch 1883
Validation auc = 0.667557
Epoch 1884
Validation auc = 0.667503
Epoch 1885
Validation auc = 0.667503
Epoch 1886
Loss = 9.3957e-06, PNorm = 128.3671, GNorm = 0.0002, lr_0 = 9.0659e-04
Loss = 3.7750e-07, PNorm = 128.3671, GNorm = 0.0000, lr_0 = 9.0657e-04
Validation auc = 0.667503
Epoch 1887
Validation auc = 0.667503
Epoch 1888
Validation auc = 0.667503
Epoch 1889
Validation auc = 0.667557
Epoch 1890
Validation auc = 0.667612
Epoch 1891
Loss = 6.6720e-06, PNorm = 128.3679, GNorm = 0.0002, lr_0 = 9.0635e-04
Validation auc = 0.667612
Epoch 1892
Validation auc = 0.667612
Epoch 1893
Validation auc = 0.667612
Epoch 1894
Validation auc = 0.667666
Epoch 1895
Validation auc = 0.667666
Epoch 1896
Loss = 6.0915e-06, PNorm = 128.3687, GNorm = 0.0001, lr_0 = 9.0612e-04
Validation auc = 0.667666
Epoch 1897
Validation auc = 0.667666
Epoch 1898
Validation auc = 0.667612
Epoch 1899
Validation auc = 0.667612
Epoch 1900
Loss = 1.2525e-05, PNorm = 128.3695, GNorm = 0.0002, lr_0 = 9.0592e-04
Loss = 4.1723e-07, PNorm = 128.3696, GNorm = 0.0000, lr_0 = 9.0590e-04
Validation auc = 0.667612
Epoch 1901
Validation auc = 0.667612
Epoch 1902
Validation auc = 0.667448
Epoch 1903
Validation auc = 0.667503
Epoch 1904
Validation auc = 0.667448
Epoch 1905
Loss = 4.0112e-05, PNorm = 128.3707, GNorm = 0.0018, lr_0 = 9.0567e-04
Loss = 7.7882e-06, PNorm = 128.3708, GNorm = 0.0003, lr_0 = 9.0566e-04
Validation auc = 0.667448
Epoch 1906
Validation auc = 0.667394
Epoch 1907
Validation auc = 0.667557
Epoch 1908
Validation auc = 0.667557
Epoch 1909
Validation auc = 0.667557
Epoch 1910
Loss = 8.1417e-06, PNorm = 128.3715, GNorm = 0.0004, lr_0 = 9.0545e-04
Validation auc = 0.667503
Epoch 1911
Validation auc = 0.667503
Epoch 1912
Validation auc = 0.667557
Epoch 1913
Validation auc = 0.667503
Epoch 1914
Validation auc = 0.667557
Epoch 1915
Loss = 9.4859e-06, PNorm = 128.3722, GNorm = 0.0004, lr_0 = 9.0521e-04
Validation auc = 0.667612
Epoch 1916
Validation auc = 0.667666
Epoch 1917
Validation auc = 0.667666
Epoch 1918
Validation auc = 0.667666
Epoch 1919
Loss = 1.3142e-05, PNorm = 128.3731, GNorm = 0.0007, lr_0 = 9.0500e-04
Loss = 4.5697e-06, PNorm = 128.3732, GNorm = 0.0002, lr_0 = 9.0498e-04
Validation auc = 0.667721
Epoch 1920
Validation auc = 0.667775
Epoch 1921
Validation auc = 0.667775
Epoch 1922
Validation auc = 0.667830
Epoch 1923
Validation auc = 0.667775
Epoch 1924
Loss = 7.1940e-06, PNorm = 128.3743, GNorm = 0.0002, lr_0 = 9.0476e-04
Validation auc = 0.667775
Epoch 1925
Validation auc = 0.667775
Epoch 1926
Validation auc = 0.667721
Epoch 1927
Validation auc = 0.667721
Epoch 1928
Validation auc = 0.667721
Epoch 1929
Loss = 9.5317e-06, PNorm = 128.3751, GNorm = 0.0002, lr_0 = 9.0454e-04
Validation auc = 0.667666
Epoch 1930
Validation auc = 0.667666
Epoch 1931
Validation auc = 0.667721
Epoch 1932
Validation auc = 0.667775
Epoch 1933
Loss = 5.8064e-06, PNorm = 128.3756, GNorm = 0.0002, lr_0 = 9.0431e-04
Validation auc = 0.667721
Epoch 1934
Validation auc = 0.667830
Epoch 1935
Validation auc = 0.667939
Epoch 1936
Validation auc = 0.667993
Epoch 1937
Validation auc = 0.667993
Epoch 1938
Loss = 1.0815e-05, PNorm = 128.3761, GNorm = 0.0002, lr_0 = 9.0409e-04
Loss = 1.4901e-06, PNorm = 128.3761, GNorm = 0.0001, lr_0 = 9.0407e-04
Validation auc = 0.668048
Epoch 1939
Validation auc = 0.667993
Epoch 1940
Validation auc = 0.668048
Epoch 1941
Validation auc = 0.667939
Epoch 1942
Validation auc = 0.667939
Epoch 1943
Loss = 7.5815e-06, PNorm = 128.3770, GNorm = 0.0002, lr_0 = 9.0386e-04
Validation auc = 0.667884
Epoch 1944
Validation auc = 0.667775
Epoch 1945
Validation auc = 0.667775
Epoch 1946
Validation auc = 0.667775
Epoch 1947
Validation auc = 0.667721
Epoch 1948
Loss = 1.6904e-05, PNorm = 128.3780, GNorm = 0.0010, lr_0 = 9.0362e-04
Validation auc = 0.667666
Epoch 1949
Validation auc = 0.667721
Epoch 1950
Validation auc = 0.667666
Epoch 1951
Validation auc = 0.667666
Epoch 1952
Loss = 5.2188e-06, PNorm = 128.3786, GNorm = 0.0001, lr_0 = 9.0341e-04
Loss = 9.3179e-06, PNorm = 128.3787, GNorm = 0.0004, lr_0 = 9.0340e-04
Validation auc = 0.668048
Epoch 1953
Validation auc = 0.668048
Epoch 1954
Validation auc = 0.668266
Epoch 1955
Validation auc = 0.668266
Epoch 1956
Validation auc = 0.668429
Epoch 1957
Loss = 2.0088e-05, PNorm = 128.3792, GNorm = 0.0009, lr_0 = 9.0317e-04
Loss = 5.8015e-06, PNorm = 128.3793, GNorm = 0.0002, lr_0 = 9.0316e-04
Validation auc = 0.668320
Epoch 1958
Validation auc = 0.668429
Epoch 1959
Validation auc = 0.668266
Epoch 1960
Validation auc = 0.668320
Epoch 1961
Validation auc = 0.668266
Epoch 1962
Loss = 2.6069e-05, PNorm = 128.3800, GNorm = 0.0010, lr_0 = 9.0295e-04
Validation auc = 0.668157
Epoch 1963
Validation auc = 0.668048
Epoch 1964
Validation auc = 0.668048
Epoch 1965
Validation auc = 0.668048
Epoch 1966
Loss = 4.9873e-06, PNorm = 128.3807, GNorm = 0.0000, lr_0 = 9.0273e-04
Validation auc = 0.667993
Epoch 1967
Validation auc = 0.667993
Epoch 1968
Validation auc = 0.667993
Epoch 1969
Validation auc = 0.668048
Epoch 1970
Validation auc = 0.668048
Epoch 1971
Loss = 1.1059e-05, PNorm = 128.3814, GNorm = 0.0002, lr_0 = 9.0250e-04
Loss = 2.3842e-07, PNorm = 128.3814, GNorm = 0.0000, lr_0 = 9.0249e-04
Validation auc = 0.668048
Epoch 1972
Validation auc = 0.667993
Epoch 1973
Validation auc = 0.668048
Epoch 1974
Validation auc = 0.668102
Epoch 1975
Validation auc = 0.668102
Epoch 1976
Loss = 1.1098e-05, PNorm = 128.3822, GNorm = 0.0003, lr_0 = 9.0228e-04
Validation auc = 0.668211
Epoch 1977
Validation auc = 0.668211
Epoch 1978
Validation auc = 0.668266
Epoch 1979
Validation auc = 0.668375
Epoch 1980
Validation auc = 0.668375
Epoch 1981
Loss = 1.0260e-05, PNorm = 128.3830, GNorm = 0.0003, lr_0 = 9.0204e-04
Validation auc = 0.668429
Epoch 1982
Validation auc = 0.668484
Epoch 1983
Validation auc = 0.668429
Epoch 1984
Validation auc = 0.668484
Epoch 1985
Loss = 5.6349e-06, PNorm = 128.3835, GNorm = 0.0001, lr_0 = 9.0183e-04
Loss = 4.9670e-07, PNorm = 128.3835, GNorm = 0.0000, lr_0 = 9.0181e-04
Validation auc = 0.668375
Epoch 1986
Validation auc = 0.668429
Epoch 1987
Validation auc = 0.668538
Epoch 1988
Validation auc = 0.668538
Epoch 1989
Validation auc = 0.668538
Epoch 1990
Loss = 8.2176e-06, PNorm = 128.3841, GNorm = 0.0003, lr_0 = 9.0159e-04
Loss = 4.9671e-07, PNorm = 128.3841, GNorm = 0.0000, lr_0 = 9.0157e-04
Validation auc = 0.668538
Epoch 1991
Validation auc = 0.668593
Epoch 1992
Validation auc = 0.668647
Epoch 1993
Validation auc = 0.668647
Epoch 1994
Validation auc = 0.668811
Epoch 1995
Loss = 7.3931e-06, PNorm = 128.3849, GNorm = 0.0002, lr_0 = 9.0137e-04
Validation auc = 0.668811
Epoch 1996
Validation auc = 0.668811
Epoch 1997
Validation auc = 0.668920
Epoch 1998
Validation auc = 0.669084
Epoch 1999
Loss = 2.0105e-05, PNorm = 128.3856, GNorm = 0.0016, lr_0 = 9.0114e-04
Validation auc = 0.669193
Model 0 best validation auc = 0.762089 on epoch 1420
Loading pretrained parameter "encoder.encoder.0.cached_zero_vector".
Loading pretrained parameter "encoder.encoder.0.W_i.weight".
Loading pretrained parameter "encoder.encoder.0.W_h.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.bias".
Loading pretrained parameter "ffn.1.weight".
Loading pretrained parameter "ffn.1.bias".
Moving model to cuda
Model 0 test auc = 0.526273
Ensemble test auc = 0.526273
10-fold cross validation
	Seed 0 ==> test auc = 0.615602
	Seed 1 ==> test auc = 0.705443
	Seed 2 ==> test auc = 0.679383
	Seed 3 ==> test auc = 0.661611
	Seed 4 ==> test auc = 0.690490
	Seed 5 ==> test auc = 0.676478
	Seed 6 ==> test auc = 0.692327
	Seed 7 ==> test auc = 0.678785
	Seed 8 ==> test auc = 0.689636
	Seed 9 ==> test auc = 0.526273
Overall test auc = 0.661603 +/- 0.050744
Elapsed time = 4:38:12
